Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Does CitusDb fit in olap analytical workloads to do aggregations on hundreds millions of records using varying order and size of dimensions (eg druid) in max of 3 seconds response time using as few boxes as possible - Or there are other techniques have to be used along with Citusdb? Can you shed a light on your experience with CloudFlare in terms of cluster size and queries perf?


Yes, Citus may be a good fit, for a complete example see:

https://www.citusdata.com/blog/15-marco-slot/402-interactive...


Hundreds of millions of records in <=3 seconds is not really a big challenge with a good data model and proper indexing on even a single server.

I work for a BI consultancy and we don't even bat an eye until we hit billions of records in a primary fact table.

Certainly the DB server does need to scale vertically to some extent as you pass through the orders of magnitude > 10M. A good columnstore engine is also worthwhile to consider.


I'll leave the initial questions to the Citus team, but re: CloudFlare this link might be helpful:

https://blog.cloudflare.com/scaling-out-postgresql-for-cloud...


Thanks. I went through it but couldnt find info about their cluster size, data size and queries response time




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: