Author Topic: Attn nerds, software question  (Read 1440 times)

never_retreat

  • Head Muckety Muck
  • friend
  • Senior Member
  • ***
  • Posts: 3,158
Attn nerds, software question
« on: December 19, 2011, 10:41:30 AM »
I run an e commerce site and I'm having trouble keeping up with other peoples sites and the prices they are selling product for.
Its a lot of work trying to browse the web and see what other people are selling stuff for.
Many of the products I sell are fixed price from the manufacture and we stick to that, but there are other vendors that lower their prices on the weekends or at night to try and capture more sales and not be seen by the supplier.
Is there any software out there that I can feed my products into and either scour the web comparing prices or scour a list of sites and report back.
I sell over 2000 items, its a daunting task.
I needed a mod to change my signature because the concept of "family friendly" eludes me.
Just noticed that a mod changed my signature. How long ago was that?
A few months-mods

RevDisk

  • friend
  • Senior Member
  • ***
  • Posts: 12,633
    • RevDisk.net
Re: Attn nerds, software question
« Reply #1 on: December 19, 2011, 10:45:58 AM »
Is there any software out there that I can feed my products into and either scour the web comparing prices or scour a list of sites and report back.
I sell over 2000 items, its a daunting task.

Besides Google Shopping? Not that I've heard of. I can't imagine retailers cooperating in sharing their pricing info, and don't tell anyone when they change their internal code so folks can easily screenscrape.
"Rev, your picture is in my King James Bible, where Paul talks about "inventors of evil."  Yes, I know you'll take that as a compliment."  - Fistful, possibly highest compliment I've ever received.

AJ Dual

  • friends
  • Senior Member
  • ***
  • Posts: 16,162
  • Shoe Ballistics Inc.
Re: Attn nerds, software question
« Reply #2 on: December 19, 2011, 11:50:45 AM »
Certainly possible, but there's no off the shelf solution that does this.

You'd have to essentially create a script that would search all your competitors for their prices, much in the way that pricegrabber.com aggregates and meta-searches a bunch of different retail sites.

You could try using one of the various news/web aggregators out there, and plug in your competitor's sites, and the products, and maybe get a quick list of links you could run down. Although there's no real guarantee that it would work, as they're made for news or social media mainly, not retail comparisons.
I promise not to duck.

CNYCacher

  • friend
  • Senior Member
  • ***
  • Posts: 4,438
Re: Attn nerds, software question
« Reply #3 on: December 19, 2011, 12:07:11 PM »
You'd have to essentially create a script that would search all your competitors for their prices, much in the way that pricegrabber.com aggregates and meta-searches a bunch of different retail sites.

This.  You are probably going to have to have one custom made.  I've done things like this in the past but not quite on the scale you are talking about.  It would be an interesting project.
On two occasions, I have been asked [by members of Parliament], "Pray, Mr. Babbage, if you put into the machine wrong figures, will the right answers come out?" I am not able to rightly apprehend the kind of confusion of ideas that could provoke such a question.
Charles Babbage

cordex

  • Administrator
  • Senior Member
  • *****
  • Posts: 8,681
Re: Attn nerds, software question
« Reply #4 on: December 19, 2011, 01:54:26 PM »
Are your products generally sold by competitors using straight prose description (i.e. "100lb bag of heavy rocks.") or by consistent item number (i.e. "GraniteCo Brand Model 4244a 100lb bag of heavy rocks.")?

A model number or consistent ID could help improve your matching potential.

230RN

  • saw it coming.
  • friend
  • Senior Member
  • ***
  • Posts: 18,935
  • ...shall not be allowed.
Re: Attn nerds, software question
« Reply #5 on: December 19, 2011, 03:35:18 PM »
Out of pure naïveté, but sometimes naïve answers provide clues.

How does Gurgle 'bot the net for search terms?  Seems to me that a variant on  their search "mechanism" is what you're looking for.   I don't know how frequently Gurgle polls the net, but I remember several instances where I was looking for a recent post and it didn't show up for a day, and other instances where it showed up in only a few minutes.

I wonder if Gurgle might provide something like what you're looking for as a service, with a list of model numbers or specific items to seek, then compile a list or you, just as they do for any search term you enter... except it runs through an inputted list of search terms automatically.

Of course, they'd have to be careful not to step on the toes of their avertisers and favored sites.

I hope I'm not embarrassing myself too much.

On the other hand, you could just have a banner on every page saying something like, "We will meet or beat any other verified on-line sale price during their sale period." 

Or even after the competition's sale period.  I guess.  Would bring in more and possibly repeat customers. I reckon.

Terry, "Naïvely looking at the problem from the outside," 230RN
WHATEVER YOUR DEFINITION OF "INFRINGE " IS, YOU SHOULDN'T BE DOING IT.

RevDisk

  • friend
  • Senior Member
  • ***
  • Posts: 12,633
    • RevDisk.net
Re: Attn nerds, software question
« Reply #6 on: December 19, 2011, 04:04:29 PM »
Out of pure naïveté, but sometimes naïve answers provide clues.

How does Gurgle 'bot the net for search terms?  Seems to me that a variant on  their search "mechanism" is what you're looking for. 

http://www.google.com/prdhp?hl=en&tab=wf
"Rev, your picture is in my King James Bible, where Paul talks about "inventors of evil."  Yes, I know you'll take that as a compliment."  - Fistful, possibly highest compliment I've ever received.

GigaBuist

  • friends
  • Senior Member
  • ***
  • Posts: 4,345
    • http://www.justinbuist.org/blog/
Re: Attn nerds, software question
« Reply #7 on: December 19, 2011, 08:24:23 PM »

bedlamite

  • Hold my beer and watch this!
  • friend
  • Senior Member
  • ***
  • Posts: 9,808
  • Ack! PLBTTPHBT!
Re: Attn nerds, software question
« Reply #8 on: December 19, 2011, 08:30:35 PM »
Now we know who is griping about monkeyleg selling moccasins below cost!
A plan is just a list of things that doesn't happen.
Is defenestration possible through the overton window?

never_retreat

  • Head Muckety Muck
  • friend
  • Senior Member
  • ***
  • Posts: 3,158
Re: Attn nerds, software question
« Reply #9 on: December 19, 2011, 09:55:04 PM »
Besides Google Shopping? Not that I've heard of. I can't imagine retailers cooperating in sharing their pricing info, and don't tell anyone when they change their internal code so folks can easily screenscrape.

Google shopping has to be fed your data. What I mean by this is if you don't feed an api into google you don't show in the products section. Bing shopping is the same way. FWI they are both free comparison shopping engines. You have to pay to feed most of the others.
I think most people use the manufactures product code.
Certainly possible, but there's no off the shelf solution that does this.

You'd have to essentially create a script that would search all your competitors for their prices, much in the way that pricegrabber.com aggregates and meta-searches a bunch of different retail sites.

You could try using one of the various news/web aggregators out there, and plug in your competitor's sites, and the products, and maybe get a quick list of links you could run down. Although there's no real guarantee that it would work, as they're made for news or social media mainly, not retail comparisons.
Thats out of my realm.
Out of pure naïveté, but sometimes naïve answers provide clues.

How does Gurgle 'bot the net for search terms?  Seems to me that a variant on  their search "mechanism" is what you're looking for.   I don't know how frequently Gurgle polls the net, but I remember several instances where I was looking for a recent post and it didn't show up for a day, and other instances where it showed up in only a few minutes.

I wonder if Gurgle might provide something like what you're looking for as a service, with a list of model numbers or specific items to seek, then compile a list or you, just as they do for any search term you enter... except it runs through an inputted list of search terms automatically.

Of course, they'd have to be careful not to step on the toes of their advertisers and favored sites.

I hope I'm not embarrassing myself too much.

On the other hand, you could just have a banner on every page saying something like, "We will meet or beat any other verified on-line sale price during their sale period." 

Or even after the competition's sale period.  I guess.  Would bring in more and possibly repeat customers. I reckon.

Terry, "Naïvely looking at the problem from the outside," 230RN
I doubt google would share their secrets.
Google indexes normal pages based on there own algorithm bases on how popular the site is, how much new data appears on the site in a given time frame and a punch of other stuff.
Adds are expensive period, especially on search engines. I don't have the funds for that.

Plus like I said its more about watching the other people. I try and play fair with the prices. If manufacture X says this is the price than I'm fine with that. It preserves my margins. Its the others that play games.
One such offender has custom code on there site that shows lower prices to people from over seas. I guess they thought that they were being tricky. I caught them and dimmed them out.
Had some ask If i could match a price. I said sure send me a link. I look at the link it had the same price as my site. I emailed them back and said its the same. He said no its not. I asked him to take a screen shot and send it to me. Sure enough it was a lower price. I checked the URL he sent me. When it hit the site I got redirected.
Manufacture of the product was here in the US so they could never see the lower price, until I emailed it to the regional rep.
I'm sure they still do it, I just can't catch them.
I think I need an overseas proxy. Anyone know of a good cheep one?
I needed a mod to change my signature because the concept of "family friendly" eludes me.
Just noticed that a mod changed my signature. How long ago was that?
A few months-mods

230RN

  • saw it coming.
  • friend
  • Senior Member
  • ***
  • Posts: 18,935
  • ...shall not be allowed.
Re: Attn nerds, software question
« Reply #10 on: December 20, 2011, 04:56:31 AM »
Thanks for the insights, all.  That pigeon article was hilarious.

Quote
Anyone know of a good cheep one?

Ouch. :)


I wouldn't expect Gurgle to release its programming.  What I was suggesting was they modify their 'botting so that you could, by $ubscription, submit a list of your products periodically (by product code or whatever), and they'd go through your list one by one and collect all the other current prices and deliver a report to you.  Might be a good product for them... who knows?

The foreign lower prices, though might be a problem.  I guess you'd have to special order that kind of report.

« Last Edit: December 20, 2011, 05:03:22 AM by 230RN »
WHATEVER YOUR DEFINITION OF "INFRINGE " IS, YOU SHOULDN'T BE DOING IT.