I’m not a Python maximalist by any stretch, but it is clearly the winner in the current data transformation/analytics/ML world. If you’re not a Python fan, then build these tools and APIs in other languages which are *easy to use*! When another ecosystem can match this usability, with better performance or environment/dependency management, for sure the industry will follow.
MF_HODL's avatar MF_HODL
Yes and no. No question, it makes builds, requirements, and environments more complicated. But it greatly simplifies the process for API end users (the data scientist or analytics engineer). These ppl tend to have deep expertise in how to use/interpret the ML models, or in data general data transformations/modeling, but not in low level computer science. I am in the this camp - but I am learning more about the lower level CS. Outside of the Python ecosystem, the only thing that comes close, wrt data science tooling, is Scala. And then you have to deal with Java bullshit 😂 If Golang, or some other “simple” lower level language (Mojo??) can step up to the plate in data tooling, then I’m sure the industry will follow.
View quoted note →

Replies (5)

Agree on the concept of “don’t let perfect be the enemy of good”. However, in programming language development, there is at least some expectation of backwards compatibility. So I can respect a slower development pace in the core language / modules.
I respect that. If i had more experience im sure id feel the same. I know few elite devs that use python which could be random or could be indicative that python is a stepping stool.
But… to my knowledge, no other language & package ecosystem has come CLOSE to Python around data analytics, ML, or AI. Rust dataframe tooling (see Polars) is getting there. But surely we can’t expect all data analyses to learn Rust 😂