i think we're only gonna be seeing more of them tho, microservices are great for llm development since they fit into context, large monorepo is harder to tackle
Login to reply
Replies (3)
NGL talking about this makes me glad I've retired. Was knee deep in the shit show a very long time.
I'm an embedded systems dev. Firmware cannot crash, especially when it's running an engine or a pacemaker. To design firmware with microservices, performing basic functions over whatever network connection you might have, would be insane.
Separation of concerns is not the same as distribution of concerns. Whenever you add a communication channel, you add a failure point and a delay, a measurable and minimum delay. Maybe that delay is small when you run 1000 microservices on the same machine, but then when it's time to "scale" across the network you increase your latency by orders of magnitude, even when you scale within the same datacenter.
To distribute concerns across the network is a valid design pattern, but it's not like waterfall v.s. agile where you maximize the "best thing" about a process, because the "beat thing" about software is not the network. Networking is a tool that has utility and tradeoffs and it always increases complexity.
I work in a 100M ARR majestic monolith daily and do not get this feeling. It’s all just subfolders and context management. In fact wonder if microservices _prevent_ LLM from getting big picture in many cases.