sync: Test and deploy MySQL option innodb_locks_unsafe_for_binlog=ON

RESOLVED WONTFIX

Status

Cloud Services
Operations: Deployment Requests
RESOLVED WONTFIX
7 years ago
4 years ago

People

(Reporter: atoll, Assigned: bobm)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Whiteboard: [qa+])

http://dev.mysql.com/doc/refman/5.1/en/innodb-parameters.html#sysvar_innodb_locks_unsafe_for_binlog

http://dev.mysql.com/doc/refman/5.1/en/set-transaction.html#isolevel_read-committed

Please enable the global parameters:

SET GLOBAL innodb_locks_unsafe_for_binlog=ON;
SET GLOBAL transaction isolation level READ COMMITTED;

In staging, with load tests before and after the change, so we can confirm that the applications continues to work as expected.

Please also smoke test with a mobile and desktop client paired to the same account doing constant surfing using the latest nightlies, so that we can be sure that back-and-forth syncing works okay.

Once confirmed safe in staging, deploy to one production server and wait a day to see if any further issues crop up, then push to the rest of prod.
will loadtest & work with jbonacci for QA.
Assignee: nobody → petef
Status: NEW → ASSIGNED
Whiteboard: [needs loadtest]
we hit a new all-time cpu usage high in stage with this tweak, worth it for production.
What's the deployment plan/schedule for this one?
re-loadtesting, had mysql "unsafe" stage mode on.

when there's a schedule, I'll link it from here
Whiteboard: [needs loadtest] → [needs loadtest][qa+]
QA picks this up for testing Monday 10/31 - Wednesday 11/2.
Working with a set of current Stage accounts (all desktop to desktop)
and a new Stage account that is a mix of desktop and mobile.
Working will Firefox 7, 8, 9, and 10.

Will be testing with and without load running.
Completed the first half of the testing while Pete ran load.
Used a mix of accounts with desktop and mobile devices.
Tested against Firefox 7, beta (8), aurora (9), and nightly (10).
Tested Mac, Windows, Linux, iOS, and Android.

Will continue Tue or Wed with similar tests while no load is applied.
Completed all testing in Stage with and without load running.
Testing included a mix of desktop and mobile devices.
Testing included FF 7, Beta, Aurora, and Nightly.

jbonacci+mobiles1, stage-sync71
jbonacci+test11, stage-sync7
jbonacci+test22, stage-sync8
jbonacci+test3, stage-sync71
jbonacci+test4, stage-sync69
jbonacci+test5, stage-sync69
jbonacci+test6, stage-sync7
jbonacci+test7, stage-sync68
verbal loadtest+ from petef, next phase is deployment
Assignee: petef → rsoderberg
Whiteboard: [needs loadtest][qa+] → [qa+]
Summary: Test and deploy MySQL option innodb_locks_unsafe_for_binlog + READ COMMITTED → sync: Test and deploy MySQL option innodb_locks_unsafe_for_binlog + READ COMMITTED
Pushed the changes live in puppet-weave/files/etc/my.cnf.*percona*, updated op to stagger restarts.
130 hosts still require a mysql restart.  adm1.phx1.svc:~rsoderberg/694222.hosts
+++ This bug was cloned as Bug #753689 +++

Separating bug 694222 into two pieces.

innodb_locks_unsafe_for_binlog=ON is this bug, READ_COMMITTED is bug 753689.
Summary: sync: Test and deploy MySQL option innodb_locks_unsafe_for_binlog + READ COMMITTED → sync: Test and deploy MySQL option innodb_locks_unsafe_for_binlog=ON
Assignee: rsoderberg → nobody
:bobm
Assignee: nobody → bobm

Updated

4 years ago
Status: ASSIGNED → RESOLVED
Last Resolved: 4 years ago
Resolution: --- → WONTFIX
You need to log in before you can comment on or make changes to this bug.