https://www.percona.com/blog/tuning-mongodb-for-bulk-loads/ Thu, 11 Apr 2024 22:19:43 +0000 hourly 1 https://wordpress.org/?v=6.5.2 https://www.percona.com/blog/tuning-mongodb-for-bulk-loads/#comment-10973108 Wed, 31 Mar 2021 19:34:00 +0000 https://www.percona.com/blog/?p=67654#comment-10973108 I think lowering thresholds from eviction_dirty_trigger=20,eviction_dirty_target=5 to eviction_dirty_trigger=5,eviction_dirty_target=1 only works if worker thread are really able to keep up. Lowering threshold for application threads from 20 to 5 only works if with given load you are able to ensure you stay mostly below 20. That configuration unfortunately didn’t help much for my load.

]]> https://www.percona.com/blog/tuning-mongodb-for-bulk-loads/#comment-10972306 Wed, 03 Jun 2020 11:36:46 +0000 https://www.percona.com/blog/?p=67654#comment-10972306 Hi Kay, unfortunately I don’t have the actual numbers to share since we didn’t finish the full load with the default settings. For this case we were estimating something like 21 days with default settings. In the end it finished in about a week.

]]> https://www.percona.com/blog/tuning-mongodb-for-bulk-loads/#comment-10972305 Wed, 03 Jun 2020 11:34:07 +0000 https://www.percona.com/blog/?p=67654#comment-10972305 Thank you Sateesh! good to hear from you

]]> https://www.percona.com/blog/tuning-mongodb-for-bulk-loads/#comment-10972296 Sun, 31 May 2020 20:29:46 +0000 https://www.percona.com/blog/?p=67654#comment-10972296 good article Ivan. Thanks for sharing

]]> https://www.percona.com/blog/tuning-mongodb-for-bulk-loads/#comment-10972211 Mon, 11 May 2020 12:43:14 +0000 https://www.percona.com/blog/?p=67654#comment-10972211 Wow! great article. Thanks for sharing.

]]> https://www.percona.com/blog/tuning-mongodb-for-bulk-loads/#comment-10972210 Mon, 11 May 2020 10:39:15 +0000 https://www.percona.com/blog/?p=67654#comment-10972210 Thanks Ivan for the great write-up! One questions though: how long did the bulk import take with mongodb’s default settings and how long did it take with your settings?

]]> https://www.percona.com/blog/tuning-mongodb-for-bulk-loads/#comment-10972197 Wed, 06 May 2020 10:58:40 +0000 https://www.percona.com/blog/?p=67654#comment-10972197 Yes that is indeed what will happen. So after done with bulk loading you should increase WT cache again.

]]> https://www.percona.com/blog/tuning-mongodb-for-bulk-loads/#comment-10972195 Wed, 06 May 2020 09:12:00 +0000 https://www.percona.com/blog/?p=67654#comment-10972195 If we reduce wiredTiger cache, will not future queries read from disk more frequently? Is this a trade off ?

]]>