0

I currently have a data solution in RDBMS. The load on the server will grow by 10x, and I do not believe it will scale.

I believe what I need is a data store that can provide fault tolerant, scalable and that can retrieve data extremely fast.

The Stats
    Records: 200 million
    Total Data Size (not including indexes):  381 GB
    New records per day: 200,000
    Queries per Sec:  5,000
    Query Result: 1 - 2000 records


Requirements
    Very fast reads
    Scalable 
    Fault tolerant
    Able to execute complex queries (conditions across many columns)
    Range Queries
    Distributed
    Partition – Is this required for 381 GB of data?
    Able to Reload from file
    In-Memory (not sure)

Not Required
    ACID - Transactions

The primary purpose of the data store is retrieve data very fast. The queries that will access this data will have conditions across many different columns (30 columns and probably many more). I hope this is enough info.

I have read about many different types of data stores that include NoSQL, In-Memory, Distributed Hashed, Key-Value, Information Retrieval Library, Document Store, Structured Storage, Distributed Database, Tabular and others. And then there are over 2 dozen products that implement these database types. This is a lot of stuff to digest and figure out which would provide the best solution.

It would be preferred that the solution run on Windows and is compatible with Microsoft .NET.

Base on the information above, does any one have any suggestions and why?

Thanks

4

1 回答 1

1

那么，你的问题是什么？我真的没有在这里看到任何重要的东西。

  • 快速且可扩展：获取数据库（抱歉，复杂查询，列 = 数据库）并获得一些 NICE SAN - HP EVA 非常棒。我已经看到它在数据库中每秒提供 800mb 的随机 IO 读取......使用 190 个 SAS 磁盘。对你来说够快吗？抱歉，这是可扩展性。

  • 400gb 的数据库大小无论如何都不是什么了不起的。

    • 找一个像样的服务器。Supermicro 有一个空间可容纳 24 个磁盘，高度为 2 个机架单元。
    • 购买更高端的 SAS RAID 控制器 - Adaptec。
    • 在 RAID 10 配置中插入 ReadSSD 驱动器。你会感到惊讶——你会比你看到的“哎哟”更快地使 IO 总线饱和。可扩展性有 24 个磁盘空间。以及每秒可处理 1.2 GB 的 IO 总线。

最后，请专业人员调整您的数据库服务器。就这么简单。正确使用 SQL Server 比“好的，我只知道选择应该是什么样子”（没有真正了解）要复杂得多。

于 2010-06-27T00:34:44.193 回答