indiehackerman•4d
Show HN: Engineering.fyi – Search across tech engineering blogs in one placeengineering.fyi

I built a search engine for engineering blogs because I was tired of manually checking individual company blogs to find real-world production examples.

The problem: When learning a new technology, the best insights often come from how companies like Google, Meta, or Stripe actually implement it in production. But these gems are scattered across dozens of separate engineering blogs with no way to search across them.

What I built: Engineering.fyi indexes engineering blogs from ~15 companies (Google, Meta, OpenAI, Anthropic, Stripe, Uber, etc.) and makes them searchable in one place. You can filter by topic, difficulty level, and whether articles include code samples.

Technical details: - Built with Next.js, SQLite, DrizzleORM - Custom scrapers for each blog (they're all frustratingly different) - Basic tagging system using content matching (still improving this)

Current status: Core search is working. Adding new blogs weekly as I index them.

Next features (based on early feedback): - AI summaries for quick article previews - Weekly digest of trending engineering insights - Save/bookmark articles (considering whether to add accounts)

Interesting challenges: - Each blog requires custom parsing logic (no standard format) - Building an accurate tagging system is harder than expected – started with exact matching but exploring better approaches

I'd love feedback on: - Which company engineering blogs you'd find most valuable to include - Whether AI summaries would actually be useful or just noise - How you currently discover engineering articles from these companies

125 comments
  • zX41ZdbW•4d

    Only 16 companies - quite sparse. May I ask to add my blog if possible? https://clickhouse.com/blog?category=engineering

    • indiehackerman•4d

      Just getting started but will definitely add to the list!

  • freetonik•4d

    Shameless plug, but hopefully relevant enough: my directory and search engine for personal blogs[1] indexes over 1000 RSS feeds, and naturally lots of them are about engineering and software development. Full-text search is implemented with Typesense, and there are also "related" recommendations for each post, example [2].

    1. https://minifeed.net/

    2. https://minifeed.net/items/n1HZYMDEKyra

    • pnt12•4d

      I was surprised that I started reading one blog on your site, and it was badly written. Only afterwards below the text, did I notice it was a summary!

      I'd advise to put it at the top, before the text, to let people know beforehand and not be caught off guard. Then you can have a big button saying "read full article in website" or something, to make it easy for people to see both options.

      • pnt12•4d

        OK turns out it was not a summary, just a preview paragraph that mixed headers and text from the original, leading to strange casing and reading. I'd suggest not to include headers there or distinguish them!

        Example (had to search on kagi with site:minifeed.net):

        You Can Either Steal Great Developers or Farm Them To grow software development teams, you can either steal excellent developers or you can develop them internally.

        • freetonik•4d

          Yeah, the parsing is suboptimal right now. I'll work on that!

      • pnt12•4d

        Also when going back the page, I don't see that post anymore - it was featured in random blogs, so I lost it.

        It's a cool idea, but maybe a improvement could be to select a random handful per day, and let them stay there for a while? Fewer surprises this way!

        • freetonik•4d

          Good idea, thanks! I was planning to modify the welcome page into that kind of "Minifeed Today" page, and to regenerate it only once a day.

    • jpmonette•4d

      Looks really nice! Any plan to add social aspect like comments, likes and such?

      • freetonik•4d

        Thought about it, but not sure yet. Not too many user yet for that sort of thing.

      • OisinMoran•4d

        I'm building something similar with a bit more of a social angle (has comments, likes, and reposts) at lynkmi.com. If you sign up to the waitlist it's a very very short wait!

    • victorbjorklund•4d

      Can we add / suggests sites?

  • gombosg•4d

    I kind of miss the RSS days when you just had your own news/blog aggregator without the annoyance of Substack, Medium or anything else.

    • rambambram•3d

      Don't act like RSS is done with. It's twenty plus years old, and still going strong. Nobody is stopping you from using it, whether you only read or also post.

      Hyped up tech is like milk, it stinks after a couple of days. Open protocols are like fine wine, they age beautifully.

      P.S. Your site is offline. If it wasn't and you even had one interesting article, I would have added your website to my list of feeds. I picked up hundreds of interesting websites/feeds through HN alone in the last years.

      • ctxc•3d

        Damn, if I knew I'd get one person to read what I write I'd have added RSS :P

    • dewey•4d

      Less people are blogging these days but there's still a lot of interesting blogs out there. It's even more self-selected than before but I almost always find a RSS feed for a blog that I think is useful and interesting.

  • angelmm•4d

    I like the concept. Many times I look for high quality articles to go deep on some topics. I recommend you the fly.io blog [1], it has really nice articles.

    [1] https://fly.io/blog/

  • skyzouwdev•4d

    I like the premise — I’ve lost count of how many times I ended up deep in Google’s search results or on page 4 of some company blog just to find a relevant architecture post.

    A couple of thoughts from my own workflow: • I’d definitely add smaller but high-signal engineering blogs. Some of the most interesting write-ups I’ve read came from companies that aren’t FAANG-level but are operating at scale (think Segment, Plaid, Posthog, Linear). They often publish very focused “lessons learned” pieces that don’t get much SEO love. • AI summaries could be useful if they’re really accurate and highlight the “why” behind a technical decision, not just rephrase the intro paragraph. I’d probably use them to triage which posts to read in full. • For discovery, I usually rely on Twitter/X and the occasional Reddit thread. The problem is that those channels are noisy — so something that’s searchable and filterable like you’ve built is appealing.

    One nit: for tagging, maybe consider a lightweight NLP approach (spaCy / transformers) that can detect concepts beyond exact matches. Even basic keyword clustering could improve relevance without needing a massive ML pipeline.

    Nice work — bookmarking this for the next time I need to dig into how someone scaled their job queues without setting their hair on fire.

  • pbronez•4d

    Cool idea. I thought I’d try to make a Kagi Lens to accomplish the same thing:

    https://kagi.com/lenses/LdYine8hZtYmrt8yTMngOUtvTM9rmkRy

    Kagi Lenses can be defined in many ways, one of which is specifying URLs to search. Unfortunately you can only provide 10 URLs per lens. Here are the ones I chose:

    https://stripe.com/blog/engineering, https://engineering.fb.com/, https://www.uber.com/en-US/blog/engineering/, https://netflixtechblog.com/, https://research.google/blog/, https://technology.riotgames.com/, https://incident.io/blog, https://www.anthropic.com/engineering, https://openai.com/news/, https://shopify.engineering/

    • pbronez•4d

      When I use this lens to search for “Python” the top three hits are:

      Meta’s Pyrefly announcement (may 2025)

      Netflix post about their overall use of python (March 2013)

      Google’s announcement of the Croissant ML metadata format (March 2024)

    • __turbobrew__•4d

      No AWS blog? If anything I have found the AWS blog the highest quality and most novel. The articles on things like route53 are really interesting.

    • jzig•4d

      Now make a lens of lenses!

  • kenanfyi•4d

    Looks good, but it‘s fascinating the term engineering nowadays almost only boils down to software(also mostly web) and AI, although it is way more than that.

    • mrugge•4d

      the engineering that pays (big bucks)

      • kawfey•3d

        idk, hardware engineering (whether electrical, mechanical, civil, aerospace, etc) is just as lucrative and IMO more interesting, since physics isn't an invention of the human mind like software is, and mistakes go boom instead of segfault.

        • kenanfyi•2d

          As an hardware engineer, I can't say if it's more interesting or not, but definitely a different mindset and tempo you have during development. Things are not running in a sandboxed environment where you can iterate theoretically endless times.

  • plucafs•4d

    I'd suggest to add the Riot Games tech blog (https://technology.riotgames.com)

    • sontek•3d

      They haven't posted since February of 2024, seems inactive?

    • indiehackerman•4d

      Adding to the list!

  • demarq•4d

    > When learning a new technology, the best insights often come from how companies like Google, Meta, or Stripe actually implement it in production.

    I think not.

  • ozgrakkurt•4d

    Amazing idea but Cloudflare DDOSes my browser when I try to open it.

    Also a nice reminder to move my website off of cloudflare asap

    • jagged-chisel•4d

      Maybe I’m a bit out of the loop on Cloudflare’s activity these days, but I’m not sure I understand your statement.

      Cloudflare thinks your browser is part of a DDoS?

      Cloudflare is attacking your browser from several places across the internet?

      • 8organicbits•4d

        My guess is that this refers to the CPU challenge. Presumably DDoS here should be DoS, specifically overwhelming their CPU or draining their battery.

        https://security.stackexchange.com/questions/278660/why-are-...

      • ozgrakkurt•4d

        On my phone, it locks up my browser with it’s “check” so I have to restart it.

        I understand it isn’t related to DDOS but used it as a joke since it is basically attacking my browser

  • skhameneh•4d

    Can you add cross support for Fediverse? I really haven't been keeping up but I think with ActivityPub you can support Bluesky, Mastodon, and Threads. A lot of the general support and progress went from GNU Social > Mastodon > whatever.

  • idosh•4d

    Shameless plug, you can find all of them and many more on https://daily.dev/. It's a personalized aggregator for developer news

  • meander_water•4d

    There's a good list here which you could add as well https://github.com/kilimchoi/engineering-blogs

    • indiehackerman•4d

      Thanks! It's a great collection and have been using that as a reference. Hasn't been updated in a while but definitely will try to add as many as I can

  • chandu_vrs•4d

    Nice work. I started working on something similar, but my use case is slightly different (but the solution is similar). We all are interested in certain topics, there is a lot of content that gets published and our time is limited, so we need something that helps us identify top 10 articles or so per topic. This is why most of us like HackerNews. I think HackerNews by topic or interest would be a good idea to implement (but along with users posting links, it can come from crawling few sites as well)

  • colesantiago•4d

    It would be great if you can add RSS on this.

  • mmargenot•4d

    Are you trying to stick with company blogs primarily, or to expand into general non-affiliated eng blogs? People like Maggie Appleton (https://maggieappleton.com/) and Patrick McKenzie (https://www.kalzumeus.com/) frequently have compelling ideas around technology, but I suppose that's a different "product" from what a company blog is selling.

    • indiehackerman•4d

      Great suggestions, I'm a big fan of Patrick McKenzie as well. I was going to start with company blogs but expand to individuals as well if there's enough demand/usage

      • mmargenot•2d

        Yeah, it's one of those things where it's very reasonable to draw a line between company and individual blogs and keep it to one or the other.

        In any case, I know there are some other solid individual blog collections in the comments - good luck with feature addition.

  • 8organicbits•4d

    > Each blog requires custom parsing logic (no standard format)

    This is unfortunate, RSS has promise to be that standard format. I've seen high adoption, but it's not universal.

    • indiehackerman•4d

      I started off with scraping through RSS but quickly realised it doesn't include all historical posts

      • lysecret•4d

        Are you using ai for the parsing/setting up the parsing structure?

  • Catbert59•4d

    First thing I saw was an annoying Cloudflare captcha.. ugh

  • marit77•3d

    Would it be possible to add the JetBrains blog? https://blog.jetbrains.com/

  • ordinarily•4d

    This is awesome! We got some really technical deep dives here https://www.warpstream.com/blog-category/engineering

  • fuzball1989•4d

    Are you sure you want to add hundreds of blogs? I would keep it curated to 10-20 otherwise it will turn into an RSS feed but I think you are chasing a goal of having the most interesting blogs to read and for people to use in their designs, coding etc.

    • indiehackerman•4d

      I think people would get less value if I kept it to 10-20. I was thinking of extending it to have user accounts were people could create their own lists of the articles (based on company, author, tags, etc) on there if there was enough interest

  • farai89•4d

    This is great. Would be good if you add RAMP also, have found the engineering blog useful. https://engineering.ramp.com/

  • brikym•4d

    I can't say I like the infinite scrolling and lack of body scroll bar.

  • ndom91•4d

    Nice one! You should definitely offer some sort of master rss feed though

  • bkhl•4d

    > Current status: Core search is working. Adding new blogs weekly as I index them.

    I guess this is a reason why it does not have recent blogs from some of the sites. Otherwise, it's definitely something I'd use

  • WASDx•4d

    FYI here is a list of hundreds of engineering blogs: https://github.com/kilimchoi/engineering-blogs

  • dgs_sgd•4d

    Awesome work! I would suggest adding Netflix’s blog [1]. It’s very high quality imo.

    [1] https://netflixtechblog.com/

  • shelika•4d

    Biased as I work for them but I think https://incident.io/blog/engineering is definitely worth adding.

  • bilguudeiblgd•3d

    It'd be nice if there' some kind of relevancy, or hottest* articles filters.

  • LtdJorge•4d

    Should definitely be able to filter out any of the sources. Unless that's already there and I'm not seeing it.

  • aeve890•4d

    >Engineering

    Looks inside

    >15 tech companies blogs

  • FailureCrown•3d

    I can't find tags for C#, asp.Net

  • cosmicgadget•4d

    Great idea and the post preview cards are excellent.

    I've found software security companies tend to have interesting blog posts.

  • __natty__•4d

    I have so many of tech blogs in my bookmarks. And I open them maybe once per month. How often do you read these blogs?

    • indiehackerman•4d

      I read them especially when I'm picking up a new task at my job with new technologies

  • dbgrman•4d

    none of the filters seem to work for me. Good concept. Wish it wasn't in the done-to-death vibe coding UI.

    • indiehackerman•4d

      Thanks for the feedback! Have made fixes to the filters so please try again

    • coldtrait•4d

      What is a more standard UI that doesn't scream vibe coded?

  • kushan2020•4d

    The performance is really slow on my phone - iPhone XR. Even selecting filters takes away lot of time.

    • indiehackerman•4d

      Made some performance improvements, hope it's better for you now!

  • g8oz•3d

    I would add: - Instacart - Temporal - Pinterest - Etsy - Atlassian

  • yieldcrv•4d

    Thanks for having a default feed to show an example of what to expect

    So many show and tells neglect that

  • kathir05•4d

    This is interesting stuff!! Love to see further updates and scale on this

    • indiehackerman•4d

      Thanks for your support! Stay tuned for more updates

  • majom•4d

    Great start. I would be great to see more blogs added to your project.

    • indiehackerman•4d

      Thanks for your support! Will definitely be adding plenty more this week

  • matkurianski•4d

    I always wanted something like that. Awesome job!

    • indiehackerman•4d

      Thanks for your support! Glad I could help build it for you :)

  • DiabloD3•4d

    Already hug of death?

  • Quitschquat•4d

    It would be cool to filter out the AI/LLM stuff

    • indiehackerman•4d

      Will add that to the list, thanks for the suggestion

  • penguin202•3d

    I'll be building a MCP for this

  • dwedge•4d

    I love this idea. Like others mentioned the cloudflare is annoying and search is way too slow, but as a concept I like it. Make it faster and I can see myself using this every week

    • indiehackerman•4d

      Thanks for the feedback! Search should be better now

      • netloks9599•4d

        I think you might want to add a "debounce" to the search, typing more than a few characters at a time automatically kicks off a new request for the entire page

  • kwakubiney•4d

    Nice project. Filtering took forever though.

    • indiehackerman•4d

      Have made improvements to the filters! Hope you get a better experience now

  • xyst•4d

    AI-grifters: "why bother using yet another search engine? In a few weeks {{preferred LLM}} will be trained on the underlying data"

  • gricardo99•4d

    nice concept. fyi, search feature doesn’t seem to work

    • indiehackerman•4d

      Thanks for your support! Search should be fixed now

  • whattheheckheck•4d

    I get an ssl error

  • ayerajath•4d

    this is good! will revisit soon!

  • anonymous344•4d

    order by latest?

  • tamimio•4d

    I believe there should be an industry standard to distinguish between engineers (the ones who spent 4-5 years in school) and software engineers (not necessarily those who spent 4-5 years in school) by name only. Either one should not be called engineers anymore, or the other should be called legacy engineers or something along these lines. I was expecting to search through articles of IEEE, RF, hardware maybe, or even other disciplines like civil and mechanical. The word "engineer" lost its meaning in the past ~2 decades because everyone now who touches a PC suddenly can call themselves an engineer, diluting the market now with hordes of bootcampers and "prompt engineers". How come we don't see the same in other white-collar jobs like doctors, nurses, lawyers, or even blue-collar ones that now require some sort of control over who calls themselves or is able to work in a trade by having apprenticeships? P. Eng isn't enforced, so it's meaningless.

    • xyzzy_plugh•4d

      I have no idea how you can dismiss P.Eng as being meaningless. Engineer, yes, certainly overloaded. But P.Eng? It literally implies licensure.

      That's the industry standard.

      My GP and my veterinarian and also my librarian are all doctors, but less ambiguously they are respectively MD, DVM and PhD.

      • tamimio•4d

        I am not the one who's dismissing it, industry does. You can get hired as an engineer, holding an engineering title with zero engineering education nowadays, you can have senior or principal title as well, and no formal education either. Find me one hospital that would hire a nurse that never had formal education or went through acquiring the proper license? No wonder a doctor can earn 4 times more than an engineer nowadays.