LinkedIn lost a lawsuit about specifically trying to prevent scraping of their job content. This was a big deal at the time as all the major job sites were scraping jobs either because a customer lacked technical capabilities or to add jobs that were not part of the corpus. It\u2019s a routine part of how the industry works in the same way that not many complain about Google scraping the Internet.
Secondly, and actually more importantly, a lot of the industry exchanges jobs using feeds. This is where CPC job distribution generally exists. These can contain \u201cfree\u201d jobs which do not get any CPC credit but would let you build something like this site without any scraping infrastructure. You can ask some major job boards for just the free jobs if you wanted that for some reason. Most job specific scraping services like Aspen and Feedonomics will deliver you scraped jobs in the your preferred feed format.
In practice where I\u2019ve worked we just blocked scraping sites when we get a complaint and respected robots.txt. It was rare for someone to complain since we were good sources of traffic wherever I worked. I am not a lawyer but my understanding is that as long as you\u2019re not otherwise breaking the law by respecting legitimate takedown notices then scraping is fair use."},"story_title":{"matchLevel":"none","matchedWords":[],"value":"Show HN: Job board aggregator for best paying remote SWE jobs in the U.S."},"story_url":{"matchLevel":"none","matchedWords":[],"value":"https://www.remoteswe.fyi"}},"_tags":["comment","author_Moto7451","story_44025484"],"author":"Moto7451","children":[44032464],"comment_text":"I\u2019ve spent most of my career in Job Tech and HR Tech so I can give you some insight.
LinkedIn lost a lawsuit about specifically trying to prevent scraping of their job content. This was a big deal at the time as all the major job sites were scraping jobs either because a customer lacked technical capabilities or to add jobs that were not part of the corpus. It\u2019s a routine part of how the industry works in the same way that not many complain about Google scraping the Internet.
Secondly, and actually more importantly, a lot of the industry exchanges jobs using feeds. This is where CPC job distribution generally exists. These can contain \u201cfree\u201d jobs which do not get any CPC credit but would let you build something like this site without any scraping infrastructure. You can ask some major job boards for just the free jobs if you wanted that for some reason. Most job specific scraping services like Aspen and Feedonomics will deliver you scraped jobs in the your preferred feed format.
In practice where I\u2019ve worked we just blocked scraping sites when we get a complaint and respected robots.txt. It was rare for someone to complain since we were good sources of traffic wherever I worked. I am not a lawyer but my understanding is that as long as you\u2019re not otherwise breaking the law by respecting legitimate takedown notices then scraping is fair use.","created_at":"2025-05-19T11:24:45Z","created_at_i":1747653885,"objectID":"44028611","parent_id":44028359,"story_id":44025484,"story_title":"Show HN: Job board aggregator for best paying remote SWE jobs in the U.S.","story_url":"https://www.remoteswe.fyi","updated_at":"2025-05-19T17:40:33Z"},{"_highlightResult":{"author":{"fullyHighlighted":true,"matchLevel":"full","matchedWords":["feedonomics"],"value":"Feedonomics"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["feedonomics"],"value":"Sr. Full Stack Software Engineer | Los Angeles, CA |www.feedonomics.com
We are looking for a highly motivated and experienced Senior Full Stack Software Engineer to join the Engineering team at Feedonomics, headquartered in Los Angeles. You will be working with a motivated and vibrant team of Engineers in developing the amazing features that power our robust and scalable SaaS platform.
Apply Here: https://feedonomics.com/join_us_careers/"},"story_title":{"matchLevel":"none","matchedWords":[],"value":"Ask HN: Who is hiring? (June 2020)"}},"_tags":["comment","author_Feedonomics","story_23379196"],"author":"Feedonomics","comment_text":"Sr. Full Stack Software Engineer | Los Angeles, CA |www.feedonomics.com
We are looking for a highly motivated and experienced Senior Full Stack Software Engineer to join the Engineering team at Feedonomics, headquartered in Los Angeles. You will be working with a motivated and vibrant team of Engineers in developing the amazing features that power our robust and scalable SaaS platform.
Apply Here: https://feedonomics.com/join_us_careers/","created_at":"2020-06-02T14:01:58Z","created_at_i":1591106518,"objectID":"23391073","parent_id":23379196,"story_id":23379196,"story_title":"Ask HN: Who is hiring? (June 2020)","updated_at":"2024-09-20T06:20:19Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"bashevis"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["feedonomics"],"value":"Feedonomics | Los Angeles | Full-Time | ONSITE | https://feedonomics.com\n-- Who We Are --
Feedonomics is a rapidly growing eCommerce advertising platform. Our clients are some of the most prolific advertising agencies, brands, and retailers in the world. We enable eCommerce clients to do Omnichannel advertising on hundreds of advertising channels like Google Shopping, Amazon, and Facebook Dynamic Product Ads. We import, optimize and feed over 300 million products an hour.
-- Open Roles --
Senior PHP Developer | Los Angeles | https://www.indeed.com/job/senior-php-developer-7ae9e79f4e45...
Senior Software Engineer | Los Angeles | https://www.indeed.com/job/senior-software-engineer-woodland...
Senior PHP Developer | Los Angeles | https://www.indeed.com/job/senior-full-stack-developer-woodl..."},"story_title":{"matchLevel":"none","matchedWords":[],"value":"Ask HN: Who is hiring? (April 2019)"}},"_tags":["comment","author_bashevis","story_19543940"],"author":"bashevis","comment_text":"Feedonomics | Los Angeles | Full-Time | ONSITE | https://feedonomics.com\n-- Who We Are --
Feedonomics is a rapidly growing eCommerce advertising platform. Our clients are some of the most prolific advertising agencies, brands, and retailers in the world. We enable eCommerce clients to do Omnichannel advertising on hundreds of advertising channels like Google Shopping, Amazon, and Facebook Dynamic Product Ads. We import, optimize and feed over 300 million products an hour.
-- Open Roles --
Senior PHP Developer | Los Angeles | https://www.indeed.com/job/senior-php-developer-7ae9e79f4e45...
Senior Software Engineer | Los Angeles | https://www.indeed.com/job/senior-software-engineer-woodland...
Senior PHP Developer | Los Angeles | https://www.indeed.com/job/senior-full-stack-developer-woodl...","created_at":"2019-04-02T22:16:39Z","created_at_i":1554243399,"objectID":"19559108","parent_id":19543940,"story_id":19543940,"story_title":"Ask HN: Who is hiring? (April 2019)","updated_at":"2024-09-20T04:03:38Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"CalmQuiet"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["feedonomics"],"value":"Yes, there's a lot of heat over Chris Anderson's \"Free: The Future of a Radical Price\". I had no idea how much - nor had bother to look at the occasional link here, so I appreciate RWW pulling together the players:
- The book: http://www.amazon.com/Free-Future-Radical-Chris-Anderson/dp/...
- Gladwell's NYTimes rev: http://www.newyorker.com/arts/critics/books/2009/07/06/09070...
- Mike Masnick's TechDirt take: http://techdirt.com/articles/20090701/0422125421.shtml
- Fred Wilson at AVC: http://www.avc.com/a_vc/2009/07/freemium-and-freeconomics.ht...
- Mark Cuban at BlogMaverick: http://blogmaverick.com/2009/07/05/the-freemium-company-life...
- Brad Feld's thoughts: http://www.feld.com/wp/archives/2009/07/would-you-want-it-if...
I especially appreciate the tip look where I might not have bothered: Wilson's post, who \"identifies the two instances when Free actually works. The first instance is the service or software that offers a free trial and then converts users into paying customers. There are different flavors of this approach, the most popular being, give the basic version for free and charge for the advanced version.\""},"story_title":{"matchLevel":"none","matchedWords":[],"value":"Free: It works, it cries, it bites. Review wars over \"Free\""},"story_url":{"matchLevel":"none","matchedWords":[],"value":"http://www.readwriteweb.com/"}},"_tags":["comment","author_CalmQuiet","story_691166"],"author":"CalmQuiet","comment_text":"Yes, there's a lot of heat over Chris Anderson's \"Free: The Future of a Radical Price\". I had no idea how much - nor had bother to look at the occasional link here, so I appreciate RWW pulling together the players:
- The book: http://www.amazon.com/Free-Future-Radical-Chris-Anderson/dp/...
- Gladwell's NYTimes rev: http://www.newyorker.com/arts/critics/books/2009/07/06/09070...
- Mike Masnick's TechDirt take: http://techdirt.com/articles/20090701/0422125421.shtml
- Fred Wilson at AVC: http://www.avc.com/a_vc/2009/07/freemium-and-freeconomics.ht...
- Mark Cuban at BlogMaverick: http://blogmaverick.com/2009/07/05/the-freemium-company-life...
- Brad Feld's thoughts: http://www.feld.com/wp/archives/2009/07/would-you-want-it-if...
I especially appreciate the tip look where I might not have bothered: Wilson's post, who \"identifies the two instances when Free actually works. The first instance is the service or software that offers a free trial and then converts users into paying customers. There are different flavors of this approach, the most popular being, give the basic version for free and charge for the advanced version.\"","created_at":"2009-07-07T09:29:13Z","created_at_i":1246958953,"objectID":"691199","parent_id":691166,"story_id":691166,"story_title":"Free: It works, it cries, it bites. Review wars over \"Free\"","story_url":"http://www.readwriteweb.com/","updated_at":"2024-09-19T16:44:02Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"theblackbox"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["feedonomics"],"value":"About 28 mins long but first 10 mins on \"freeconomics\" .... anyone else struggle to find an agreeable pronunciation of that word!
From blurb:
How have web companies like Google, YouTube and Yahoo! built successful businesses when most of their products are free?
That's the question Wired magazine's editor-in-chief Chris Anderson asks in his new book FREE. Gareth chats to him about 'freeconomics' and future business models for net content.
Chris also shares his passion for building DIY Drones. These are small unmanned aerial vehicles, built by amateur enthusiasts using 'open source' hardware."},"story_title":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["feedonomics"],"value":"BBC Digital Planet: Chris Anderson (ed. in chief of wired) on \"Freeconomics\""},"story_url":{"matchLevel":"none","matchedWords":[],"value":"http://www.bbc.co.uk/programmes/p003jcll"}},"_tags":["comment","author_theblackbox","story_682423"],"author":"theblackbox","comment_text":"About 28 mins long but first 10 mins on \"freeconomics\" .... anyone else struggle to find an agreeable pronunciation of that word!
From blurb:
How have web companies like Google, YouTube and Yahoo! built successful businesses when most of their products are free?
That's the question Wired magazine's editor-in-chief Chris Anderson asks in his new book FREE. Gareth chats to him about 'freeconomics' and future business models for net content.
Chris also shares his passion for building DIY Drones. These are small unmanned aerial vehicles, built by amateur enthusiasts using 'open source' hardware.","created_at":"2009-07-01T11:20:20Z","created_at_i":1246447220,"objectID":"682427","parent_id":682423,"story_id":682423,"story_title":"BBC Digital Planet: Chris Anderson (ed. in chief of wired) on \"Freeconomics\"","story_url":"http://www.bbc.co.uk/programmes/p003jcll","updated_at":"2024-09-19T16:43:05Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"wmf"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["feedonomics"],"value":"The privately owned data center concept is unsustainable
It's not clear what you're saying here, but I think I strongly disagree. Data centers have real economies of scale (both in dollars and in availability) which shouldn't be ignored. Web 2.0 \"freeconomics\" may be unsustainable, but you don't have to use that business model; you can make data centers (or \"the cloud\") work for you.
...and defeats the concept the internet, which is distributed data.
IMO the concept of the Internet is to move packets, and servers are equally legitimate as PCs."},"story_title":{"matchLevel":"none","matchedWords":[],"value":"Opera Unite reinvents the Web: a Web server on the Web browser"},"story_url":{"matchLevel":"none","matchedWords":[],"value":"http://www.opera.com/press/releases/2009/06/16/"}},"_tags":["comment","author_wmf","story_659696"],"author":"wmf","comment_text":"The privately owned data center concept is unsustainable
It's not clear what you're saying here, but I think I strongly disagree. Data centers have real economies of scale (both in dollars and in availability) which shouldn't be ignored. Web 2.0 \"freeconomics\" may be unsustainable, but you don't have to use that business model; you can make data centers (or \"the cloud\") work for you.
...and defeats the concept the internet, which is distributed data.
IMO the concept of the Internet is to move packets, and servers are equally legitimate as PCs.","created_at":"2009-06-16T19:11:22Z","created_at_i":1245179482,"objectID":"660705","parent_id":660228,"points":null,"story_id":659696,"story_title":"Opera Unite reinvents the Web: a Web server on the Web browser","story_url":"http://www.opera.com/press/releases/2009/06/16/","updated_at":"2023-09-06T19:50:58Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"jtrn"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["feedonomics"],"value":"Makes sense. It\u2019s already illegal to even attempt to commit suicide here, so compared to that, this is just another small way the state micromanages your entire life.
Sarcasm aside, I wonder if they calculated how much we save by not trashing these items, versus the cost in time, bureaucracy, and administration this will demand. There is an episode of Freconomics that covered this. Managing and getting rid of free stuff is very expensive and hard. But that someone else's problem."},"story_title":{"matchLevel":"none","matchedWords":[],"value":"EU bans the destruction of unsold apparel, clothing, accessories and footwear"},"story_url":{"matchLevel":"none","matchedWords":[],"value":"https://environment.ec.europa.eu/news/new-eu-rules-stop-destruction-unsold-clothes-and-shoes-2026-02-09_en"}},"_tags":["comment","author_jtrn","story_47025378"],"author":"jtrn","children":[47025693,47025923],"comment_text":"Makes sense. It\u2019s already illegal to even attempt to commit suicide here, so compared to that, this is just another small way the state micromanages your entire life.
Sarcasm aside, I wonder if they calculated how much we save by not trashing these items, versus the cost in time, bureaucracy, and administration this will demand. There is an episode of Freconomics that covered this. Managing and getting rid of free stuff is very expensive and hard. But that someone else's problem.","created_at":"2026-02-15T17:30:14Z","created_at_i":1771176614,"objectID":"47025552","parent_id":47025378,"story_id":47025378,"story_title":"EU bans the destruction of unsold apparel, clothing, accessories and footwear","story_url":"https://environment.ec.europa.eu/news/new-eu-rules-stop-destruction-unsold-clothes-and-shoes-2026-02-09_en","updated_at":"2026-03-05T23:33:12Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"anamax"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["feedonomics"],"value":"> You would think - but I believe it was Freakonomics that did a story wherein they discovered that a large part of the Prius' success over other hybrids was due to its unique and recognizable styling.
That \"success over other hybrids\" is local. Specifically, the freaonomics folks found that the market share of hybrids that don't look different is pretty much constant across the US. The prius, which is distinctive, doesn't sell like that. Its market share seems to vary with the dominant political party - it's very popular in Dem regions and just average in Repub regions."},"story_title":{"matchLevel":"none","matchedWords":[],"value":"Look out, Nissan Leaf: Tesla S will sell for under $50,000, run for 160 miles"},"story_url":{"matchLevel":"none","matchedWords":[],"value":"http://www.extremetech.com/extreme/110193-look-out-nissan-leaf-tesla-s-will-sell-for-under-50000-run-for-160-miles"}},"_tags":["comment","author_anamax","story_3386288"],"author":"anamax","comment_text":"> You would think - but I believe it was Freakonomics that did a story wherein they discovered that a large part of the Prius' success over other hybrids was due to its unique and recognizable styling.
That \"success over other hybrids\" is local. Specifically, the freaonomics folks found that the market share of hybrids that don't look different is pretty much constant across the US. The prius, which is distinctive, doesn't sell like that. Its market share seems to vary with the dominant political party - it's very popular in Dem regions and just average in Repub regions.","created_at":"2011-12-23T18:15:59Z","created_at_i":1324664159,"objectID":"3386571","parent_id":3386553,"points":null,"story_id":3386288,"story_title":"Look out, Nissan Leaf: Tesla S will sell for under $50,000, run for 160 miles","story_url":"http://www.extremetech.com/extreme/110193-look-out-nissan-leaf-tesla-s-will-sell-for-under-50000-run-for-160-miles","updated_at":"2023-09-06T20:51:28Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"Erikun"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["feedonomics"],"value":"Frekonomics' look at the art market, part 1 of 3."},"story_title":{"matchLevel":"none","matchedWords":[],"value":"A Fascinating, Sexy, Intellectually Compelling, Unregulated Global Market"},"story_url":{"matchLevel":"none","matchedWords":[],"value":"https://freakonomics.com/podcast/a-fascinating-sexy-intellectually-compelling-unregulated-global-market/"}},"_tags":["comment","author_Erikun","story_29824446"],"author":"Erikun","comment_text":"Frekonomics' look at the art market, part 1 of 3.","created_at":"2022-01-06T15:10:42Z","created_at_i":1641481842,"objectID":"29824447","parent_id":29824446,"story_id":29824446,"story_title":"A Fascinating, Sexy, Intellectually Compelling, Unregulated Global Market","story_url":"https://freakonomics.com/podcast/a-fascinating-sexy-intellectually-compelling-unregulated-global-market/","updated_at":"2024-09-20T10:11:03Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"djug"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["feedonomics"],"value":"I am a big fan of freakonomics podcast, I think it is the only podcast that I have listened to all of its episodes (more than 300).
what I like more about freekonomics is the quality of the great books they usually discuss in their podcasts, they do even interview their authors sometimes.
Since I\u2019m always seeking new good books to read, I\u2019ve gone ahead and collected all of their books in one easy to use website, not only to fill my own need, but for anyone interested in this great list.
If you and me are in the same club, feel free visit and share"},"story_title":{"matchLevel":"none","matchedWords":[],"value":"Show HN: FreakonomicsBooks \u2013 List of All books discussed in Freakonomics podcast"},"story_url":{"matchLevel":"none","matchedWords":[],"value":"http://freakonomicsbooks.com/"}},"_tags":["comment","author_djug","story_15507751"],"author":"djug","comment_text":"I am a big fan of freakonomics podcast, I think it is the only podcast that I have listened to all of its episodes (more than 300).
what I like more about freekonomics is the quality of the great books they usually discuss in their podcasts, they do even interview their authors sometimes.
Since I\u2019m always seeking new good books to read, I\u2019ve gone ahead and collected all of their books in one easy to use website, not only to fill my own need, but for anyone interested in this great list.
If you and me are in the same club, feel free visit and share","created_at":"2017-10-19T13:41:22Z","created_at_i":1508420482,"objectID":"15507761","parent_id":15507751,"story_id":15507751,"story_title":"Show HN: FreakonomicsBooks \u2013 List of All books discussed in Freakonomics podcast","story_url":"http://freakonomicsbooks.com/","updated_at":"2024-09-20T01:26:51Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"roovno"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["feedonomics"],"value":"Currently, Freeconomics is just FREE service. Nothing less.Nothing more.\nRoovno is Freeconomics + Some revenue. That is, services are Freeconomics plus additional revenue. \nFor example,a new webmail service [say,roovnomail.com] with revenue generation capabilities for its users will definitely have an edge over current mail giants..."},"story_title":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["feedonomics"],"value":"The Fall Of Freeconomics. Why $0.00 Is NOT the Future of Business"},"story_url":{"matchLevel":"none","matchedWords":[],"value":"http://roovno.com/free/"}},"_tags":["comment","author_roovno","story_150027"],"author":"roovno","children":[150226,150421],"comment_text":"Currently, Freeconomics is just FREE service. Nothing less.Nothing more.\nRoovno is Freeconomics + Some revenue. That is, services are Freeconomics plus additional revenue. \nFor example,a new webmail service [say,roovnomail.com] with revenue generation capabilities for its users will definitely have an edge over current mail giants...","created_at":"2008-03-30T15:50:33Z","created_at_i":1206892233,"objectID":"150155","parent_id":150036,"points":null,"story_id":150027,"story_title":"The Fall Of Freeconomics. Why $0.00 Is NOT the Future of Business","story_url":"http://roovno.com/free/","updated_at":"2023-09-06T19:11:41Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"mdemare"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["feedonomics"],"value":"What interests me is the cause of freeconomics. People easily pay lots of money on all kinds of stuff, but are extremely hesitant to buy anything on the web.
My gmail account is worth at least hundreds of dollars to me, but I pay nothing for it. $25 per year seems entirely reasonable considering the value it offers, but if Google charged money, nearly all users would flee.
Why are people so reluctant to spend money on the web?"},"story_title":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["feedonomics"],"value":"Beware of Freeconomics"},"story_url":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["feedonomics"],"value":"http://www.readwriteweb.com/archives/beware_of_freeconomics.php"}},"_tags":["comment","author_mdemare","story_124226"],"author":"mdemare","children":[124429,124442],"comment_text":"What interests me is the cause of freeconomics. People easily pay lots of money on all kinds of stuff, but are extremely hesitant to buy anything on the web.
My gmail account is worth at least hundreds of dollars to me, but I pay nothing for it. $25 per year seems entirely reasonable considering the value it offers, but if Google charged money, nearly all users would flee.
Why are people so reluctant to spend money on the web?","created_at":"2008-02-27T02:02:46Z","created_at_i":1204077766,"objectID":"124426","parent_id":124226,"points":null,"story_id":124226,"story_title":"Beware of Freeconomics","story_url":"http://www.readwriteweb.com/archives/beware_of_freeconomics.php","updated_at":"2023-09-06T19:09:41Z"}],"hitsPerPage":20,"nbHits":12,"nbPages":1,"page":0,"params":"query=feedonomics&advancedSyntax=true&analyticsTags=backend","processingTimeMS":14,"processingTimingsMS":{"_request":{"queue":1,"roundTrip":22},"afterFetch":{"merge":{"mergeLoop":{"prepareNextHit":5,"total":6},"total":7},"total":7},"fetch":{"query":5,"total":6},"total":14},"query":"feedonomics","serverTimeMS":16}