Fri, 16 Feb 2024 21:36:52 +0000 en-US hourly 1 https://wordpress.org/?v=6.5.2 https://www.percona.com/blog/wp-content/uploads/2023/02/cropped-percona-favicon-32x32.png 32 32 76301791 https://www.percona.com/blog/backup-and-restore-with-mydumper-on-docker/ https://www.percona.com/blog/backup-and-restore-with-mydumper-on-docker/#comments Tue, 16 May 2023 12:29:39 +0000 https://www.percona.com/blog/?p=87270 At the end of 2021, I pushed the first Docker image to hub.docker.com. This was the first official image and since then, we have been improving our testing and packaging procedures based on Docker, CircleCI, and GitHub Actions. However, when I’m coding,  I’m not testing in Docker. But a couple of weeks ago, when I […]]]> https://www.percona.com/blog/backup-and-restore-with-mydumper-on-docker/feed/ 2 87270 https://www.percona.com/blog/masquerade-your-backups-to-build-qa-testing-environments-with-mydumper/ https://www.percona.com/blog/masquerade-your-backups-to-build-qa-testing-environments-with-mydumper/#respond Mon, 10 Apr 2023 13:59:07 +0000 https://www.percona.com/blog/?p=86316 For a long time, MyDumper has been the fastest tool to take Logical Backups. We have been adding several features to expand the use cases. Masquerade was one of these features, but it was only for integer and UUID values. In this blog post, I’m going to present a new functionality that is available in […]]]> https://www.percona.com/blog/masquerade-your-backups-to-build-qa-testing-environments-with-mydumper/feed/ 0 86316 https://www.percona.com/blog/upload-ongoing-mydumper-backups-to-s3/ https://www.percona.com/blog/upload-ongoing-mydumper-backups-to-s3/#comments Wed, 30 Nov 2022 14:07:02 +0000 https://www.percona.com/blog/?p=83574 If you are using MyDumper as your Logical Backup solution and you store your backups on S3, you need to take a local backup and then upload it to S3. But what if there is not enough space to hold the backup on the server where we are taking the backup? Even if we have […]]]> https://www.percona.com/blog/upload-ongoing-mydumper-backups-to-s3/feed/ 1 83574 https://www.percona.com/blog/ftwrl-on-mydumper-removed/ https://www.percona.com/blog/ftwrl-on-mydumper-removed/#respond Wed, 17 Aug 2022 13:20:05 +0000 https://www.percona.com/blog/?p=82186 The title is not entirely true, but ‘FTWRL on MyDumper is not needed anymore for consistent backups’ was a long title. One more time, I wanted to share a new feature in MyDumper. This is related to an important piece: the locking mechanism that mydumper uses to sync all the threads.MyDumper was born because, at […]]]> https://www.percona.com/blog/ftwrl-on-mydumper-removed/feed/ 0 82186 https://www.percona.com/blog/mydumper-stream-implementation/ https://www.percona.com/blog/mydumper-stream-implementation/#respond Fri, 03 Jun 2022 13:35:10 +0000 https://www.percona.com/blog/?p=81006 As you might know, mysqldump is single-threaded and STDOUT is its default output. As MyDumper is multithreaded, it has to write on different files. Since version 0.11.3 was released in Nov 2021, we have the possibility to stream our backup in MyDumper. We thought for several months until we decided what was the simplest way […]]]> https://www.percona.com/blog/mydumper-stream-implementation/feed/ 0 81006 https://www.percona.com/blog/mydumper-0-12-3-1-is-now-available/ https://www.percona.com/blog/mydumper-0-12-3-1-is-now-available/#comments Mon, 09 May 2022 12:11:16 +0000 https://www.percona.com/blog/?p=80894 The new MyDumper 0.12.3-1 version, which includes many new features and bug fixes, is now available.  You can download the code from here. MyDumper is Open Source and maintained by the community, it is not a Percona, MariaDB, or MySQL product.In this new version we focused on: Refactoring tasks: Splitting mydumper.c and myloader.c into multiple […]]]> https://www.percona.com/blog/mydumper-0-12-3-1-is-now-available/feed/ 2 80894 https://www.percona.com/blog/attack-no-pk-replication-lag-with-mysql-percona-server-8-invisible-columns/ https://www.percona.com/blog/attack-no-pk-replication-lag-with-mysql-percona-server-8-invisible-columns/#comments Tue, 18 Jan 2022 13:32:03 +0000 https://www.percona.com/blog/?p=79796 The most common issue when using row-based replication (RBR) is replication lag due to the lack of Primary keys.The problem is that any replicated DML will do a full table scan for each modified row on the replica. This bug report explains it more in-depth: https://bugs.mysql.com/bug.php?id=53375For example, if a delete is executed on the following […]]]> https://www.percona.com/blog/attack-no-pk-replication-lag-with-mysql-percona-server-8-invisible-columns/feed/ 3 79796 https://www.percona.com/blog/mydumper-github-repository-is-now-an-organization/ https://www.percona.com/blog/mydumper-github-repository-is-now-an-organization/#respond Fri, 03 Dec 2021 15:17:19 +0000 https://www.percona.com/blog/?p=78872 For a long time, MyDumper has been in Max Bubenick’s personal GitHub repository. Now, we decided to move to a new MyDumper’s Organization as requested earlier this year by a user from the community.There were also two other reasons why we decided to move it. The first one is related to how the project is […]]]> https://www.percona.com/blog/mydumper-github-repository-is-now-an-organization/feed/ 0 78872 https://www.percona.com/blog/pxc-scheduler-handler-the-missing-piece-for-galera-percona-xtradb-cluster-puzzle/ https://www.percona.com/blog/pxc-scheduler-handler-the-missing-piece-for-galera-percona-xtradb-cluster-puzzle/#respond Wed, 01 Dec 2021 14:06:28 +0000 https://www.percona.com/blog/?p=78094 Working on a real case scenario in a five node Percona XtraDB Cluster (PXC), we were forced to use wsrep_sync_wait = 1, because the app does reads-after-write and we send reads to all the nodes. We had the idea to leave some nodes in DESYNC mode to reduce the flow control messages during peak load […]]]> https://www.percona.com/blog/pxc-scheduler-handler-the-missing-piece-for-galera-percona-xtradb-cluster-puzzle/feed/ 0 78094 https://www.percona.com/blog/mydumper-0-11-3-is-now-available/ https://www.percona.com/blog/mydumper-0-11-3-is-now-available/#respond Mon, 29 Nov 2021 13:01:16 +0000 https://www.percona.com/blog/?p=79043 The new MyDumper 0.11.3 version, which includes many new features and bug fixes, is now available.  You can download the code from here.We are very proud to announce that we were able to achieve the two main objectives for the milestone ZSTD and Stream support!  We added four packages with ZSTD support because not all […]]]> https://www.percona.com/blog/mydumper-0-11-3-is-now-available/feed/ 0 79043 https://www.percona.com/blog/mydumper-0-11-1-is-now-available/ https://www.percona.com/blog/mydumper-0-11-1-is-now-available/#comments Tue, 21 Sep 2021 12:51:05 +0000 https://www.percona.com/blog/?p=78127 The new MyDumper 0.11.1 version, which includes many new features and bug fixes, is now available.  You can download the code from here.For this release, there are three main changes: 1) we added config file functionality which allows users to set session-level variables (one of the most requested features!), 2) we developed a better and […]]]> https://www.percona.com/blog/mydumper-0-11-1-is-now-available/feed/ 2 78127 https://www.percona.com/blog/myloader-stops-causing-data-fragmentation/ https://www.percona.com/blog/myloader-stops-causing-data-fragmentation/#respond Mon, 23 Aug 2021 14:55:39 +0000 https://www.percona.com/blog/?p=77742 During the development of the myloader –innodb-optimize-keys option, which was released in version 0.10.7, we found several issues and opportunities to improve the process. We had to change the approach, reimplement some of the core functionality and add a couple of data structures. That allowed us to implement, at a really low cost, a feature […]]]> https://www.percona.com/blog/myloader-stops-causing-data-fragmentation/feed/ 0 77742 https://www.percona.com/blog/mydumper-0-10-7-is-now-available/ https://www.percona.com/blog/mydumper-0-10-7-is-now-available/#respond Tue, 06 Jul 2021 11:51:33 +0000 https://www.percona.com/blog/?p=76767 The new MyDumper 0.10.7 version, which includes many new features and bug fixes, is now available.  You can download the code from here. For this release, we have added several features like WHERE support that is required for partial backups. We also added CHECKSUM for tables which help to speed up the restore of large […]]]> https://www.percona.com/blog/mydumper-0-10-7-is-now-available/feed/ 0 76767 https://www.percona.com/blog/restore-strategies-with-mydumper/ https://www.percona.com/blog/restore-strategies-with-mydumper/#respond Tue, 08 Jun 2021 13:07:23 +0000 https://www.percona.com/blog/?p=76292 In my previous post Back From a Long Sleep, MyDumper Lives!, I told you that Fast Index Creation was in the queue and (after fixing several bugs) it will package in release 0.10.7 next month. But why am I so excited about it? Well, this feature opens new opportunities, what I’m going to call Restore […]]]> https://www.percona.com/blog/restore-strategies-with-mydumper/feed/ 0 76292 https://www.percona.com/blog/mydumper-0-10-5-is-now-available/ https://www.percona.com/blog/mydumper-0-10-5-is-now-available/#comments Fri, 07 May 2021 16:53:47 +0000 https://www.percona.com/blog/?p=75883 The new MyDumper 0.10.5 version, which includes many new features and bug fixes, is now available.  You can download the code from here. For this release, we focused on fixing some old issues and testing old pull requests to get higher quality code. On releases 0.10.1, 0.10.3, and 0.10.5, we released the packages compiled against […]]]> https://www.percona.com/blog/mydumper-0-10-5-is-now-available/feed/ 3 75883 https://www.percona.com/blog/back-from-a-long-sleep-mydumper-lives/ Wed, 21 Apr 2021 18:29:59 +0000 https://www.percona.com/blog/?p=75399 MySQL databases keep getting larger and larger. And the larger the databases get, the harder it is to backup and restore them.  MyDumper has changed the way that we perform logical backups to enable you to restore tables or objects from large databases. Over the years it has evolved into a tool that we use […]]]> 75399 https://www.percona.com/blog/is-a-session-analyzer-a-good-tool-to-simulate-real-traffic/ Tue, 23 Mar 2021 15:02:09 +0000 https://www.percona.com/blog/?p=74624 Starting a long time ago, we wanted to reproduce workload in a non-production environment, and there were different attempts to achieve that goal (Query Playback is just one of them). But there is another point of view, where you need to write your own workload to do so.Both Have Pros and ConsReproduce Workload:Pros: Simple to […]]]> 74624 https://www.percona.com/blog/proxysql-binary-search-solution-for-rules/ https://www.percona.com/blog/proxysql-binary-search-solution-for-rules/#comments Fri, 28 Aug 2020 16:05:48 +0000 https://www.percona.com/blog/?p=70096 We sometimes receive challenging requests… this is a story about one of those times.The customer has implemented a sharding solution and would like us to review alternatives or improvements. We analyzed the possibility of using ProxySQL as it looked to be a simple implementation. However, as we had 200 shards we had to implement 200 […]]]> https://www.percona.com/blog/proxysql-binary-search-solution-for-rules/feed/ 1 70096 https://www.percona.com/blog/multithreaded-alter-table-with-pt-online-schema-change-and-myloader/ https://www.percona.com/blog/multithreaded-alter-table-with-pt-online-schema-change-and-myloader/#comments Wed, 13 May 2020 14:57:23 +0000 https://www.percona.com/blog/?p=66727 pt-online-schema-change emulates the way that MySQL alters tables internally, but it works on a copy of the table you wish to alter. It executes INSERT statements to import the data, that runs in a single connection to fill the new table. In this repository, there is a script called myloader_pt-osc.sh that uses myloader to execute […]]]> https://www.percona.com/blog/multithreaded-alter-table-with-pt-online-schema-change-and-myloader/feed/ 2 66727 https://www.percona.com/blog/using-pt-heartbeat-with-proxysql/ Thu, 02 Jan 2020 20:29:06 +0000 https://www.percona.com/blog/?p=64271 ProxySQL and Orchestrator are usually installed to achieve high availability when using MySQL replication. On a failover (or graceful takeover) scenario, Orchestrator will promote a slave, and ProxySQL will redirect the traffic. Depending on how your environment is configured, and how long the promotion takes, you could end up in a scenario where you need […]]]> 64271