Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

"A pandas-like data expression system providing comprehensive coverage of the functionality already provided by Impala. It is composable and semantically complete; if you can write it with SQL, you can write it with Ibis, often with substantially less code."

This sounds really interesting, but my biggest gripe with pandas is that I often know exactly the query I want to run with SQL but have to jump through a ton of hoops and a weird join syntax to figure out how to make the query in pandas. IMHO if you want to make data processing language as full-featured as SQL, why not just use SQL as the query language...



Having both designed pandas and suffered from some of the rough edges of pandas when used in a database-like way, I tried to be thoughtful in designing the Ibis API to be semantically complete with SQL (i.e. so you shouldn't have to write any SQL) and a great deal more productive and reusable than SQL. I suggest you give it a serious try before passing judgment!


And separate from the issue of whether it's a good or bad idea, it will shortly be possible to send raw SQL queries to the backend.

https://github.com/cloudera/ibis/issues/412




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: