Search before asking
- I had searched in the issues and found no similar issues.
Description
TiKV is a low latency, strongly consistent, highly available key-value database that supports ACID transactions. It has been used to store metadata for some infrastructures and services, for example:
- Metadata of the Object Storage Service in JD Cloud: https://www.cncf.io/blog/2019/11/26/case-study-tikv-in-jd-cloud/
- Metadata of the JuiceFS, which is a POSIX file system designed for cloud-native environment: https://juicefs.com/blog/en/posts/juicefs-release-v016/
TiKV is also the storage of TiDB, a distributed HTAP database used by 1500+ users in production. Which gives it the following strengths:
- Low maintenance overhead for existing TiDB users, the SOPs, KBs of TiDB storage layer can be reused
- No need to learn how to maintain another system for metadata storage
Use case
By adopting TiKV, it enables us to solve the following problems:
- Doris stores metadata in local disk, caches it in memory in a specific format. It might be inconvenient to view or modify it
- As the cluster and data grow, there might be more metadata needed to be stored, the current metadata storage mechanism might be a bottleneck
Related issues
N/A
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct
2条答案
按热度按时间f4t66c6m1#
Currently, doris store rowset meta and tablet meta in local rocksdb. Could you explain more detail why need to store it to a external global KV store?
llycmphe2#
Doris's FE and BE both has metadata, so which part do you want to replace?
Can you offer more detailed design?