Comments on: The Road Story of a MyRocks/MariaDB Migration https://www.percona.com/blog/the-road-story-of-a-myrocks-mariadb-migration/ Wed, 07 Oct 2020 13:51:02 +0000 hourly 1 https://wordpress.org/?v=6.5.2 By: cdccscxcxcx https://www.percona.com/blog/the-road-story-of-a-myrocks-mariadb-migration/#comment-10972755 Wed, 07 Oct 2020 13:51:02 +0000 https://www.percona.com/blog/?p=70199#comment-10972755 Take a look at data blocks format_version too since this can improve performance too.

]]>
By: Vojtech Kurka https://www.percona.com/blog/the-road-story-of-a-myrocks-mariadb-migration/#comment-10972705 Thu, 17 Sep 2020 17:55:29 +0000 https://www.percona.com/blog/?p=70199#comment-10972705 We’ve developed our own partition management system. Some partitions are dropped daily, some once per month etc. It works very well with InnoDB/MyISAM.
Rewriting that system to use MyRocks (without partitions) is not an option, it would not be cost effective. It’s much cheaper to buy bigger SSDs now.
I’ve already spent many hours migrating the data, learning all the settings, and have run into this problem now, when I turned the replication on. What a shame 🙂

Yves, do you think it’s possible to sponsor development of online DDL and better partition support in MyRocks?

If I understand the problem correctly, Facebook does not need online DDL, because they are using OnlineSchemaChange for all schema changes, right?

]]>
By: Yves Trudeau https://www.percona.com/blog/the-road-story-of-a-myrocks-mariadb-migration/#comment-10972704 Thu, 17 Sep 2020 17:07:52 +0000 https://www.percona.com/blog/?p=70199#comment-10972704 That’s one of the MyRocks limitation. Do you absolutely need partitions? Can you alter the partitions on all servers in bulk mode?

]]>
By: Vojtech Kurka https://www.percona.com/blog/the-road-story-of-a-myrocks-mariadb-migration/#comment-10972703 Thu, 17 Sep 2020 16:12:04 +0000 https://www.percona.com/blog/?p=70199#comment-10972703 When I send

ALTER TABLE mytable ADD PARTITION (PARTITION p8 VALUES LESS THAN (8000000))’;

from InnoDB master to MyRocks replica, I get:

[ERROR] [MY-010584] [Repl] Slave SQL for channel ”: Error ‘Got error 10 ‘Operation aborted: Failed to acquire lock due to rocksdb_max_row_locks limit’ from ROCKSDB’ on query. Default database: ‘xyz’. Query: ‘ALTER TABLE xyz.mytable ADD PARTITION (PARTITION p8 VALUES LESS THAN (8000000))’, Error_code: MY-001296
[Warning] [MY-010584] [Repl] Slave: Inplace partition altering is not supported Error_code: MY-000138

1.) is there any chance to execute ALTER TABLE through replication?
2.) is there any plan to support ADD/DROP PARTITION without rebuilding the whole table?

For us, this is a show stopper. I really wanted to use MyRocks, but I can’t 🙁

Thank you, Vojtech

]]>
By: Mark Callaghan https://www.percona.com/blog/the-road-story-of-a-myrocks-mariadb-migration/#comment-10972589 Wed, 05 Aug 2020 18:11:52 +0000 https://www.percona.com/blog/?p=70199#comment-10972589 Thank you for an interesting migration story

]]>