OCG/Deployments

Planned deployments, linked from Deployments. For a list of past deployments, look for 'ocg' in Server Admin Log.
See OCG#Deploying changes to learn how to deploy a new version of OCG.
=== 2016-10-03 ===
ocg-collection:
* master: 02e56525e389860554b745fb11d7a12b0a73ee5f ( https://gerrit.wikimedia.org/r/313900, https://gerrit.wikimedia.org/r/313912 )
* wmf-deploy: 0bf27e3452dfdc770317f15793e93e6e89c7865a ( https://gerrit.wikimedia.org/r/313913, https://gerrit.wikimedia.org/r/313915 )
phab:T147211: Add en.wiktionary.org to blacklist temporarily to prevent DoS.
Deployed new service (d0f8e126f5d1ad53358c7c7380ca02f41c33ead6):
* phab:T147211: Allow administrators to blacklist renders of certain metabooks.
Deployed new latexer (45c30840d22a7590cee904aff5f2e272c75d3bdb):
* phab:T144120: Add `\FloatBarrier`s after articles.
=== 2016-08-17 ===
ocg-collection:
* master: 4e4ae265aa318977bd27efb3bef1c9f7e77f5d74 ( https://gerrit.wikimedia.org/r/305391 )
* wmf-deploy: e3e0fd015ad8fdbf9da1838c830fe4b075c59a29 ( https://gerrit.wikimedia.org/r/305393 )
Deployed new bundler (40ba27f770480cb1642ed58ef18b986ec67b0daf):
* Remove rest.wikimedia.org, the server is being shut down Sept 1. (phab:T133001)
Deployed new service (51d2eb6d47dfc5225d8d5bc45444e81cc233b1c7):
* Add metrics for number of items in collections.
Deployed new texter (63333e2c2d04f00c379ac35cac9d85af7096e767):
* Add option to emit `blessed`-style markup.
=== 2016-05-10 ===
ocg-collection:
* master: 0175556808e1d13e3d9d57146f7b2f1e6fdb7f3d ( https://gerrit.wikimedia.org/r/287749 )
* wmf-deploy: b0c57a1c6890e9fa1f2c3743fc14cb6a7f244fc3 ( https://gerrit.wikimedia.org/r/287751, https://gerrit.wikimedia.org/r/287760 )
Deployed new service (ac2dff089f66fd5f6d50d7e7cd046cfd5558ac59):
* Update npm dependencies; switch to `babybird` Promise implementation.
 
Deployed new bundler (e33963029ff99f63a54fae78515b742375d88a3c):
* Update npm dependencies; switch to `babybird` Promise implementation.
 
Deployed new latexer (544a26ae19eb0e0c0ae9bea98e24630b8ca7982b):
* Update npm dependencies; switch to `babybird` Promise implementation.
 
Deployed new texter (df26683c689eb282dba55b0f287fd71307c4a2e2):
* Update npm dependencies; switch to `babybird` Promise implementation.
Dependencies were rebuilt.
The improved Promise implementation should fix the recursive nextTick issues encountered in phab:T120079.
=== 2016-05-01 ===
ocg-collection:
* master: 853da6128fe4eb61dbf53b000108f5f43837e3d5 ( https://gerrit.wikimedia.org/r/286525 )
* wmf-deploy: b775e612520f9cd4acaea42226bcf34df07439f7 ( https://gerrit.wikimedia.org/r/286526 )
Deployed new bundler (d1b9c6b1e73766d056a3a80773da1e2cd38bd851):
* Fix --domainname option when bundling a collection from the command line.
Deployed new latexer (77b0b9d45bf15021a7b2e79a8bee3f528e2e5943):
* Add sawNonSpace internal flag to avoid problems when forcing a newline.
* Skip images inside headings.
=== 2016-04-27 ===
ocg-collection:
* master: 1835986c0e9da75c806de25d062c460726c54a42 ( https://gerrit.wikimedia.org/r/285717 )
* wmf-deploy: e39e06570083877d5498da577758cf8d162c1af4 ( https://gerrit.wikimedia.org/r/285719 )
Deployed new service (fc936c8ad7893d606ff67e5fa2fe4f62e755e5fe):
* Allow decommissioning OCG hosts. phab:T120077
* Periodically check for configuration file changes. (Not enabled in default configuration.)
* Improve graceful shutdown.
=== 2016-04-25 ===
ocg-collection:
* master: b0d3fac4774fef86a93a8b78f0d8a2fb43640d8a ( https://gerrit.wikimedia.org/r/285270 )
* wmf-deploy: 58a720508deb368abfb7652e6a8c7225f95402d2 ( https://gerrit.wikimedia.org/r/285277 )
Deployed new service (4442920b712dad67e3ca7c7bf6af4a37a794405d):
* Update README.
Deployed new bundler (c4f4c4b212aada9646dbc113b6db352f51408f75):
* Don't fallback to rest.wikimedia.org.
* Use domain for status messages if prefix is not available.
* Resolve titles even when $wgArticlePath involves a query string. phab:T124762
* Send Accept header to Parsoid/RESTBase to get data-mw attributes inline. phab:T130685
Deployed new latexer (3ff99a570acf7b8f3a8af3c47f02b02ac5aad01c):
* Update README.
Deployed new texter (6b6ef440cb03c16d79c76e123044ee8e48b9c6b8):
* Use released version 0.3.3. (No code changes.)
=== 2016-03-17 ===
ocg-collection:
* master: 55aa3bd0e4d1d48d69fab392059da8d0e10bcee4 ( https://gerrit.wikimedia.org/r/278038 )
* wmf-deploy: c1a8232594fe846bd2374efd8f7c20d7e97ac449 ( https://gerrit.wikimedia.org/r/278040 )
Deployed new bundler (1fec608a4d55e7bddb115122dd0db0fd4bc88570):
* Use underscores in titles sent to the RESTBase / Parsoid API.
=== 2016-01-26 - 2016-01-27 ===
Originally planned for 2016-01-20, deferred to 2016-01-25, then phab:T124720 prevented actual deploy to labs until ~9am PST 2016-01-26. However, the redis server was down in labs (phab:T124791,phab:T124677). That was fixed ~10am PST. Deployed to production 2016-01-27 in our usual deploy window.
* Deployed to BETA: 2016-01-26
* Deployed to PRODUCTION: 2016-01-27
ocg-collection:
* master: 89f4e89eb7763d6fe8e51e5ca19fa2f72732b860 ( https://gerrit.wikimedia.org/r/265416 , https://gerrit.wikimedia.org/r/265796, https://gerrit.wikimedia.org/r/265820 )
* wmf-deploy: 64050af0456a43344b32e3e93561a79207565eaf ( https://gerrit.wikimedia.org/r/265417 , https://gerrit.wikimedia.org/r/265797 , https://gerrit.wikimedia.org/r/265821 , https://gerrit.wikimedia.org/r/265833)
Rebuilt dependencies.
Deployed new service (8a9626602a907ef6c2cb825119292933245efede):
* Update dependencies; delint code.
Deployed new bundler (6491a016302de2db86a8ee14238ce5f25707df74):
* Use body_only instead of bodyOnly in REST v1/Parsoid v3 API.
* New --fetch-modules option (turned off by default). phab:T114788
* Add username to the User-Agent header.
* Remove most references to parsoid-lb.eqiad.wikimedia.org. phab:T110474
* Handle protocol-relative API URLs.
* Update dependencies; delint code.
Deployed new latexer (28793564325d1f5c941ce2d3be0b6cd288ae714f):
* Update dependencies; delint code.
Deployed new texter (73f7b86871abff978c818ce3941c52072b0e53f5):
* Update dependencies; delint code.
=== 2015-09-16 ===
ocg-collection:
* master: 5a1e6611157bc06f20b4b3b8c77f20c6dd6c1418 ( https://gerrit.wikimedia.org/r/238862 )
* wmf-deploy: 4032a596ce6eb442b02cc6ee9b79263b1eb23275 ( https://gerrit.wikimedia.org/r/238864 )
Deployed new bundler (f673740b2a61b0bda64b0e58f7b7e596e3e7de4d):
* Released version 1.3.0
* Work around bug with --domain CLI option.
Deployed new latexer (2c2727487be7af4d55c78982a8891b6dd1ee01d2):
* Released version 0.3.1.
Deployed new texter (3d4ab2dcdb3ab39cc781b757792a1ee8419fae6d):
* Work around bug with --domain CLI option.
* Improve layout of preformatted content.
* Released version 0.3.2.
=== 2015-09-14 ===
ocg-collection:
* master: f3d66a7be00bbf7e0a019165b361f31481d3a419 ( https://gerrit.wikimedia.org/r/238217 )
* wmf-deploy: 5811056e28f2bc6408b6da96095352ab381bb11f ( https://gerrit.wikimedia.org/r/238218 )
Deployed new bundler (8d8cd3ec79367fa086a203768971e5aaa26811a8):
* Add User-Agent header to API requests.
* : Add Parsoid v3 API support.
* Remove the (broken) --api option alias.
 
Deployed new texter (de5a441228dc6e6e8eafd68f198ea6fa33de6049):
* Support "standalone mode" for single-article conversion.
=== 2015-06-23 pm ===
ocg-collection:
* master: b9a2f3c4a696a4d0c205833beb0dac9b84bb7112 ( unchanged from 2015-06-22 deploy )
* wmf-deploy: db7a56965233a74c73917c78b5c8c84c867321d9 ( https://gerrit.wikimedia.org/r/220158 )
Rebuilt dependencies on the wmf-deploy branch again, this time including the required request package.
=== 2015-06-23 am (reverted) ===
Attempted to deploy d7c698d5bf730d34057945e912ac75dc542dd788 to production.
Found that labs machines have native Ubuntu node-* packages installed which are not installed in production.
This made production fail -- the most immediate cause was that the npm request package was missing from the wmf-deploy repo (due to an issue with the npm prune step of make production), but it wasn't noticed during the beta canary deploy because deployment-pdf01 had the Ubuntu node-request package installed.
Reverted production to ca4f64852de5b1de782b292b50038fbd2dd84266 (2015-05-20 deploy).
=== 2015-06-22 (beta only) ===
ocg-collection:
* master: b9a2f3c4a696a4d0c205833beb0dac9b84bb7112 ( https://gerrit.wikimedia.org/r/220050 )
* wmf-deploy: d7c698d5bf730d34057945e912ac75dc542dd788 ( https://gerrit.wikimedia.org/r/220073 )
Deployed new bundler (fe21e6f1577f571ea83226ba04dbe0285e50e710):
* Update rimraf dependency.
* Update sqlite3 dependency for compatibility with node > 0.10.
* Convert ocg-bundler to make use of the https addresses.
* : Add "AttributionRequired" metadata to OCG bundle.
* Parsoid v2 API uses `body` as a query parameter, not `bodyOnly`.
* Use SPDX license.
Deployed new latexer (dd0e83952ec12d0ca675b63396424b3a4330e1e6):
* Update sqlite3 dependency for compatibility with node > 0.10.
* : Use Devanagari script for Bhojpuri wikipedia.
* Use SPDX license.
Deployed new service (2941c3dc0f25c654d7ddab1b82ecb726728551e1):
* Update hiredis to latest version.
* Update bunyan, bunyan-syslog, and gelf-stream.
* Update node redis to support redis 2.8.x, which has been installed in beta/labs.
* Update rimraf and mv dependency.
* Use SPDX license.
Deployed new texter (bb897807e5ffa62788f8036bc58d31bf78b079f5):
* Update sqlite3 dependency for compatibility with node > 0.10.
* Use SPDX license.
Repeat of the earlier deploy attempt, after upgrading dependencies to fix redis issue.
A patch to the Collection extension ( https://gerrit.wikimedia.org/r/220069 ) was also necessary to fix labs.
=== 2015-06-22 (cancelled) ===
ocg-collection:
* master: eb1c9eab95db2b90969afc65ef833d318cf04cef ( https://gerrit.wikimedia.org/r/219974 )
* wmf-deploy: b482144f5bd8b427bcc64a3dd287247195aa1951 ( https://gerrit.wikimedia.org/r/219975 )
Deployed new bundler (0d70ff85138da5cdd5ec0147f6eaba5bb8f49a91):
* Convert ocg-bundler to make use of the https addresses
* : Add "AttributionRequired" metadata to OCG bundle.
* Parsoid v2 API uses `body` as a query parameter, not `bodyOnly`.
* Use SPDX license.
Deployed new latexer (9d81c73ae4bc1555b6f513639a025c5f5f09ffd6):
* : Use Devanagari script for Bhojpuri wikipedia.
* Use SPDX license.
Deployed new service (65ce1bb81bff63b810a9b135811edb9b5f147e3d):
* Use SPDX license.
Deployed new texter (cbea03456f0c53212bb7d228bee1f09fcb88686e):
* Use SPDX license.
This deploy was cancelled after being deployed to beta, since beta ran into redis problems.
Redis apparently was upgraded to 2.8.x, which made node-redis unhappy.'''
=== 2015-05-20 ===
ocg-collection:
* master: 7c13ac3a6d31b28e7c740bc734bfcc1b66261053 ( https://gerrit.wikimedia.org/r/212443 )
* wmf-deploy: ca4f64852de5b1de782b292b50038fbd2dd84266 ( https://gerrit.wikimedia.org/r/212445 )
 
Deployed new latexer (e08a3d09a547d19b9c4b2a630851505f1ed5146d):
* : improve text rendering for nepali languages.
=== 2015-05-13 ===
ocg-collection:
* master: fb7ddd4422775264146729efc8ef1817d9d17387 ( https://gerrit.wikimedia.org/r/210762 )
* wmf-deploy: c7c75e5b03ad9096571dc6dbfcb7022c924ccb4f ( https://gerrit.wikimedia.org/r/210809 )
** Rebuilt all node dependencies.
 
Deployed new bundler (24365a9154a86c6870e89b2256ee5bc1d88f5a49):
* Add --php-api option for local debugging.
* Fix file revision lookup failures.
* : Allow bundler to fetch parsed articles from RESTBase.
* Switch from es6-shim to core-js; update prfun and jshint.
 
Deployed new latexer (efae1a449bfaf2fa925f1968101fafedf87edb48):
* Switch from es6-shim to core-js; update prfun and jshint.
 
Deployed new service (efa690d717ae257879a4dfbdd7ecc9227b586bed):
* Remove deprecated download command.
* Add script to allow date-based cache cleaning.
* Update docs and config options to allow use of RESTBase.
* Switch from es6-shim to core-js; update prfun and jshint.
 
Deployed new texter (e325556133e9ece9af20631d91635574a0b6f8d0):
* Switch from es6-shim to core-js; update prfun and jshint.
=== 2015-03-23 ===
ocg-collection:
* master: 8fe14ed4abf61e48f4ccb2db0cca34663f169abb ( https://gerrit.wikimedia.org/r/198797 )
* wmf-deploy: 11f096b6e45ef183826721f5c6b0f933a387b1bb ( https://gerrit.wikimedia.org/r/198798 )
Deployed new latexer (39534c0e9f0a48b6c3565fe8b50f437103e0d218):
* : use {{DISPLAYTITLE}} or subpage title where appropriate.
=== 2014-12-11 ===
ocg-collection:
* master: c170637f16c20959be1b2be326b6037ffb76c252 ( https://gerrit.wikimedia.org/r/179245 )
* wmf-deploy: bfc3812ef346c9f767135b339cedd123a1bcac98 ( https://gerrit.wikimedia.org/r/179246 )
Deployed new service (f6f3788da146e92dce8dcb11a14479c8b117f2be):
* Ensure we exit when `clear-host-cache` is done.
* Don't swallow output from helper scripts unless `--quiet` is given.
* Separate out `download` and `download_file` commands.
=== 2014-12-03 ===
ocg-collection:
* master: 8b6f18ba88ac1b13ad72957a16bf8bcae8de5d6d ( https://gerrit.wikimedia.org/r/176822 )
* wmf-deploy: 08e94b19c3f17e699d7e53d9605f65c58e17ea0e ( https://gerrit.wikimedia.org/r/177327 )
Deployed new service (4952462b0045d0f22ce31eaa80d671e9b3dc9350):
* Don't halt gc due to readdir after clean; more verbose error reporting.
* Ensure that directories are initialized in GC thread.
* Fix GC of failed jobs.
* Fix job progress status indication.
* Record which host picks up a job.
* Add script to allow host decommissioning.
* Be sure that `console.log` appears on console output.
Deployed new bundler (8565c79549e107ffa10fa817d00348b85ba9dbb9):
* Hook up npm-travis.
=== 2014-12-01 ===
ocg-collection:
* master: 2706fe8a81db85134386c4719a2f95e2a7cf1c99 ( https://gerrit.wikimedia.org/r/176792 )
* wmf-deploy: a06e7c186796a6ee5d5af81e93688520abdf2596 ( https://gerrit.wikimedia.org/r/176795 )
Deployed new service (3bcfaa00595c8b331175577286733030328d146b):
* Limit memory usage during directory clean up.
* Don't halt gc if a directory is bad.
=== 2014-11-26 ===
ocg-collection:
* master: a9cc798c5bbb204ebeb34e1f15d603e04e9dfa90 ( https://gerrit.wikimedia.org/r/176054 )
* wmf-deploy: 7d8f2b8bd496464041e3ef9c092732457cc8f7ef ( https://gerrit.wikimedia.org/r/176057 )
Deployed new service (447940eba611ef65f9d251b86c63345c26b7adb5):
* Don't use the writer as part of the renderTempDir.
* Validate 'writer' parameter before creating a job object.
* Remove stringified metabook from most log messages.
=== 2014-11-10 ===
ocg-collection:
* master: 87e3d8fdbd596ce685d5d0193eea6014c2ab5581 ( https://gerrit.wikimedia.org/r/172407 )
* wmf-deploy: d9855961b18f550f62c0b20da70f95847a215805 ( https://gerrit.wikimedia.org/r/172409 )
** Limit time spent running image helpers.
Deployed new service (2b2816081120a5e65f5bf80c294b2a85a1de38f8):
* Double cache lifetime of successful renders, to 4 days.
* Send SIGKILL if SIGTERM doesn't do the job (after execution timeout).
 
Deployed new bundler (a93dd0c9935cb6db56da4f6289d66adbdc0710d3):
* Better debugging if article name resolution fails.
 
Deployed new latexer (c4c7f7515ea337f05c2d4d851029ba90e469a8f8):
* Add `--helper-exec-limit` option to protect against runaway image helpers.
=== 2014-11-03 ===
ocg-collection:
* master: 48c701b7f43fafd10fdf711f9186fddcfa5d28e5 ( https://gerrit.wikimedia.org/r/170788 )
* wmf-deploy: 5834af97ae80382f3368dc61b9d119cef0fe129b ( https://gerrit.wikimedia.org/r/170791 https://gerrit.wikimedia.org/r/170803 https://gerrit.wikimedia.org/r/170826 https://gerrit.wikimedia.org/r/170836 )
Deployed new service (379cea3f9b3678bb83963296fdb55e5b3e8887fa):
* Allow prevention of retries of failed jobs.
* Update dependencies.
* Add _version API endpoint.
* Switch from winston to bunyan for logging.
Deployed new bundler (c9bf3d430721dfd2553a49dbe31790113916e006):
* Don't create pipes for P.spawn (avoid blocking unexpectedly).
* Update dependencies.
Deployed new latexer (aad4dfbab9e6d6c8d05ec82679843541dfd504ca):
* Prevent 100% CPU hang on certain input text.
* Don't create pipes for P.spawn (avoid blocking unexpectedly).
* Update dependencies.
Deployed new texter (8712aeb6e6490b558a22e964ec1bdf995cfd9ca0):
* Don't create pipes for P.spawn (avoid blocking unexpectedly).
* Update dependencies.
=== 2014-10-27 ===
ocg-collection:
* master: 0a6ff8841b0510f18c6cf3b1444e2bc9b3ea14d3 ( https://gerrit.wikimedia.org/r/169203 )
* wmf-deploy: 60b15d9985f881aadaa5fdf7c945298c3d7ebeac ( https://gerrit.wikimedia.org/r/169205 )
Deployed new service (fe36c9cf355955870c8edb8eac216821899ce970):
* Set TMPDIR for the renderer (don't clutter /tmp).
 
Deployed new bundler (7851aa2d51265eefdef0cf0edf012e7b6e418c3c):
* Suppress console output during zip (avoid a possible hang).
 
Deployed new latexer (bd96f76038f9df8ece71e29ea2c1fbf005605077):
* Suppress console output during unzip (avoid a possible hang).
=== 2014-10-22 ===
ocg-collection:
* master: cd40a9c15318ecc23bdb587a73e3f9dab10931fa ( https://gerrit.wikimedia.org/r/168178 )
* wmf-deploy: e977e2c8ecacea2b4dee837933cc2ffdc6b214cb ( https://gerrit.wikimedia.org/r/168183 )
Deployed new service (f0f6951d09e570ef114567a0ca6e3180af0553d9):
* Force images to be 600x600 pixels maximum.
Deployed new bundler (7296508d17f6634490cf079cb0fe03c175ff4ace):
* Fix "image size too big" check.
This was User:Arlolra's first OCG deploy.
=== 2014-10-21 ===
ocg-collection:
* master: e94c80cfb3ef472cda55b5dcf0ee51fa3895af52 ( https://gerrit.wikimedia.org/r/167879 )
* wmf-deploy: 523c8123cd826c75240837c42aff6301032d8ff1 ( https://gerrit.wikimedia.org/r/167882 )
** Limit execution time to 1 hour (which should be very generous).
Deployed new service (6a1b6a17a4d6e2f7d4b8c6bd0d6f033d425fd886):
* Update bug URL for the package.
* Factor out configuration file parsing and logging setup.
Deployed new bundler (f25c1956333a124e4cffec8a3ee52a2f4c5f76a3):
* Add ability to limit the number of simultaneous requests for small wikis ().
Deployed new latexer (dda888e5f64008c71cc37221f942a404e3a32107):
* Properly clean up while running tests ().
* PDF can't handle UTF-8 URLs ().
=== Prepared 2014-10-9, Deployed 2014-10-20 ===
ocg-collection:
* master: dffde256e9098db1ab3673479084ac6c45fa3b7c ( https://gerrit.wikimedia.org/r/165967 )
* wmf-deploy: ea10c93aca9bc1cae34f284fd74bb05d4b6a8cc6 ( https://gerrit.wikimedia.org/r/165969 )
Deployed new service (c4c7fbfb743306ad0dd7dfce1475ded536f68f97):
* Log metabook on every request.
Deployed new latexer (820334a8452762f958e3ebf1a5342d9a667a7b0a):
* Allow lists nested nine level deep ().
* Fix non-curly quotes (`extquotedbl` in output).
* Don't crash when the page title is RTL.
=== 2014-10-8 ===
ocg-collection:
* master: 79f41af0374dbe1b8ddf259334f49f8b4ee04e8c ( https://gerrit.wikimedia.org/r/165638 )
* wmf-deploy: def24eca7de566bc77ac89cbf55d04a32a2c0cf9 ( https://gerrit.wikimedia.org/r/165641 )
Deployed new service (160404df14fb3e92b7b5fff3121a13ee55887bfd):
* Use inline content disposition, instead of attachment.
Deployed new bundler (71100ec7c7b86fc7ded21aa9977dd303213f4281):
* Command-line prefix guessing tweak.
Deployed new latexer (8097c38e172a0d358694d800feacc0af075d3cc2):
* Disable PDF page splitting by default.
** Fixes crash on :en:Information_and_communication_technologies_for_development
=== 2014-10-7 ===
ocg-collection:
* master: 530c0937abc8db5efff9d34e4cb84a9c79f91730 ( https://gerrit.wikimedia.org/r/165387 )
* wmf-deploy: c778ea8b898f8ad8c2b7ad9de78a75469e7ed061 ( https://gerrit.wikimedia.org/r/165388 )
Deployed new service (531bfb404ce39debfc028c3c2ae72e7f1c59d661):
* Use article title as download filename (, ).
* The rl writer should be an alias for rdf2latex (fixes "I got plaintext when I tried to download my PDF using an old link").
* Ignore backwards-compatibility settings field in metabook.
Deployed new bundler (f55bf164145bd1390a565480a87e04cc640deba4):
* Properly resolve URLs to decode titles.
** Fixes :en:AC-130A/E/H/U Spectre/Spooky/Pave Pronto/Plain Jain/Surprise Package.
Deployed new latexer (fdde609f819679eca109d6a49851bf1e70006172):
* Support Lao, Khmer, Tibetan, Macedonian, Aramaic, and Bosnian.
* Improve CJK support.
* Be careful about square brackets inside \item[...].
* Support djvu images, but only extract first page by default.
** djvu images will be skipped until https://gerrit.wikimedia.org/r/165329 is deployed.
* Use narrower margins.
* Equations should be flush left and not indented ().
=== 2014-10-6 (afternoon) ===
ocg-collection:
* master: d75b5f63305e90f70f8d60f8da11a6d559dddb98 ( https://gerrit.wikimedia.org/r/165093 )
* wmf-deploy: bbdf4c6400cfbbc6030114ad16e1a6f7025eab2c ( https://gerrit.wikimedia.org/r/165095 )
** Limit bundle sizes to 512MB (which should be very generous). ()
Deployed new service (5fad457ac6536ccf2fb88df02b31215b2d14cb7b):
* Avoid use of redis `hkeys`; fix OOM during gc.
* Don't stop gc'ing if a file disappears.
Deployed new bundler (efbeee40948f80532a3e423e4d1813338c206f5f):
* Add options to limit bundle and image size. (bug 71647)
Deployed new texter (b7a64572c93f11d75cb2c029c13b2a78f74ed480):
* Fix line wrapping.
=== 2014-10-6 (morning) ===
GC fixes.
ocg-collection:
* master: 2423a0523b76c8828d411816b82e80841efce15e ( https://gerrit.wikimedia.org/r/164990 )
* wmf-deploy: aee3712b352f51f96569de0bcccf3facf654e688 ( https://gerrit.wikimedia.org/r/164991 )
Deployed new service (6579c1b1a01e09c6d3806a74b8e3e2152c293aae):
* Use proper extension for downloaded file (partial fix for bug 71286)
* Log the total user-experienced render time to statsd
* Shrink expiry for temp files and postmortem files (to 6 hours and 1 day, respectively)
* Reduce basic cache expiry time to 2 days (from 3)
* Bug fix: utime was setting directory times 1000 years in the future.
* Bug fix: we were only gc'ing the first subdirectory in the output directory.
=== 2014-10-2 ===
Remaining parts of mwlib deconfig: https://gerrit.wikimedia.org/r/164099
=== 2014-10-1 ===
Turned off mwlib PDF: https://gerrit.wikimedia.org/r/163609
ocg-collection:
* master: e8b3287d0a8f14b8df40477863fa86f1af9ef096 ( https://gerrit.wikimedia.org/r/164170 )
* wmf-deploy: 48c495e3656f528abe636ce0cd7562270505534f ( https://gerrit.wikimedia.org/r/164198 )
Deployed new service (e603a4d79badfabdcd9c2cea6ec6606b18dfd116):
* Reduce default job lifetime from 5 days to 3 days.
* Disable folder size computation in health check unless explicitly requested. (bug 71260)
* Improve statistics collection and measure cache effectiveness.
* Various improvements to the load testing scripts.
Deployed new bundler (352f9e02316b698bce4fe4da42f0791ff5df591b):
* Use released version 1.1.0.
Deployed new latexer (0e4ec243d6087a940bbb0954697ba79c1235f772):
* Save and restore stack of inline decorations around environments, \item, etc.
Deployed new texter (07b0cc6f6ca1c13ec8ce3c1e06b665bb314f6653):
* Minor changes to travis infrastructure.
=== 2014-09-29 ===
Made OCG default renderer in production: https://gerrit.wikimedia.org/r/163608
ocg-collection:
* master: 275655a6699815d3f42b363c228966f264a431f3 (https://gerrit.wikimedia.org/r/163617)
* wmf-deploy: 89d8f29a24295b05d0643abe976fea83b56575c9 (https://gerrit.wikimedia.org/r/163618)
Deployed new service (037f01ca8c9c9beb66ddfca6d1f78c69b59df97f):
* Fix redis garbage collection of status objects.
* Fix redis key expiration time (should be seconds, not milliseconds).
* Improve the gc cleanDir function to handle nested directories.
* Write output files in subdirectories to avoid having an excessive number of files in one directory.
* Remove some blocking operations in the backend.
* Ensure postmortem moves complete before cleanup.
Deployed new latexer (de5b32c9579169067f3dd87ef04675184c278e77):
* Treat zh language code as if it were zh-Hans (that is, Simplified Chinese)
* Match language codes case-insensitively.
=== 2014-09-25 ===
ocg-collection:
* master: 510ebee7f61da9e1810e14335a7ebc374adc35d2 (https://gerrit.wikimedia.org/r/163102)
* wmf-deploy: f3a6c1cbba118d4a5e1aa019937dc50159fc823d (https://gerrit.wikimedia.org/r/163103)
Deployed new service (2946c8901cbd5fcb8abf7bb8cb63b579066bbe17):
* Speed up/cache directory size computation in health check (bug 71260).
Deployed new latexer (144bdd2962702abaa468a18c343509a0945c11e4):
* Support Simplified and Traditional Chinese scripts.
* Don't crash if images are inside <dt> tags.
* Fix TeX escaping of [].
* Fix "There's no line here to end." crasher (<br> after <dd>).
* Ensure that we switch to the latin font where necessary.
* Indic language support (fixes for Assamese, Gujarati, Marathi, Oriya, and Punjabi).
=== 2014-09-24 ===
ocg-collection:
* master: d9f09fb29e15ded43069a4cf5c68cfe4e18c9af3 (https://gerrit.wikimedia.org/r/162755)
* wmf-deploy: 48acb8a2031863e35fad9960e48af60a3618def9 (https://gerrit.wikimedia.org/r/162756)
ocg-collection changes:
* Added load testing tool.
* Set parsoid endpoint for OCG on wikisource.
Deployed new service (34dce8513b9ce0f6c84b22f854f3d732c36c779e):
* Clean up directory size computation, eliminate a spurious log message.
* Add force_render option to help page.
Deployed new bundler (90d0700afb5937ec9ec5bf43f37b653dd1559828):
* Improve Metabook.fromArticles so that it can be used from load testing tool.
* Handle redirects from subpages (for example, :en:Children's_Heritage/D_O_A).
Deployed new latexer (86c1e14305b5109acd68a6bbd3b129692563c195):
* Don't crash if PNG has bogus resolution information (for example, [[File:Frederick-II-of-Prussia-Coloured-drawing.png]]).
* Support inline images (like in :en:⠦).
=== 2014-09-23 ===
ocg-collection:
* master: d185bde4ce038fe288d4a3be8450600573ac5866 (https://gerrit.wikimedia.org/r/162446)
* wmf-deploy: 1cf9281ec3e01d6cbb27053de9f2423582fcc156 (https://gerrit.wikimedia.org/r/162452 https://gerrit.wikimedia.org/r/162454)
Deployed new service (6d1c4a5e00d51ee55eb739ce5469cf7f47a4efa8):
* Hash all metabook props for the collection id. (Don't cache too aggressively.)
Deployed new bundler (0d8e3664d9347eb6d5c02ec8b3e8db1bb546ca4c):
* Reduce default image resolution to 150 dpi (bug 68576).
* Don't crash on images in subpages, or images with invalid titles.
* Don't crash on bad image metadata (work around bug 71135).
Deployed new latexer (d5ea61db485f6f01554c83abd47a88c2e709e8a0):
* Fix CJK definition in polyglossia.
* Add font and language information for additional indic languages.
* Don't crash if section/chapter title contains a URL.
* Don't crash if we encounter an uncontained <li>.
* Don't crash if <div> begins a figure caption.
* Don't crash on ;#.
* Don't crash if chapter has no items.
* Add support for metabook toc option == "auto".
* Upgrade node-icu-bidi to v0.1.3.
=== 2014-09-18 ===
Beta is still unhappy: see https://bugzilla.wikimedia.org/show_bug.cgi?id=71031
ocg-collection:
* master: 9b91c5e12988d3e0703934e0012f9b2b60b6d740 (https://gerrit.wikimedia.org/r/161392)
* wmf-deploy: ce16f7adb60d7c77409e2e11ba0e5d6cce6955d5 (https://gerrit.wikimedia.org/r/161394 https://gerrit.wikimedia.org/r/161395)
Deployed new bundler (021a70cd7680ffe2c814df2c1dd8c94cb565e031)
* Fix unreliable image streaming (bug 68929)
* Tighter query for images
* Use default papersize when bundling
 
Deployed new latexer (9686d0e937c7ed502353f346419abff84d420448)
* Convert TIFF images to PNG (bug 70866)
* Handle animated GIFs (bug 70865)
* Accept papersize settings from metabook (bug 68836)
Rebuilt all dependencies:
* easyimage removed
* node-icu-bidi updated to 0.1.3.
=== 2014-09-15 ===
Deployed to prod, but skipped deploy to beta/labs due to deployment-salt issues.
ocg-collection:
* master: d05617f56f213c336fd0aec9bea1b79e8c5357cc (https://gerrit.wikimedia.org/r/160515)
* wmf-deploy: 188a3c221d927bd0601ef5e1b0c0f4a9d1cdbd31 (https://gerrit.wikimedia.org/r/160517)
Deployed new service (f00852507bed9f86fc24198db5a474dd1881f392):
* Log metabook on error.
* Allow logging extended information from the backends.
 
Deployed new bundler (55aa6bea33e29053b76b2043d2c96bcb2f4f1964):
* Save title redirect information.
* Increase retries of truncated downloads from 3 to 5.
* Don't crash if a referenced image was deleted or otherwise missing.
* Redirect more logging through new log framework.
* Handle missing contributor information.
 
Deployed new latexer (03c8b04355e31d2b3d2aa80c505215bcd13a2676):
* Properly escape HTML anchors and id attributes.
* Pass additional details to logger on XeLaTeX failures.
=== 2014-09-09 ===
ocg-collection:
* master: 966e43e6c262b507f0c7a5e96c56451a96fa6f3c (https://gerrit.wikimedia.org/r/159363)
* wmf-deploy: c9a2b4cf2502479eeabed07ab2de728695d96e46 (https://gerrit.wikimedia.org/r/159375)
Rebuilt all dependencies on deployment-pdf01.eqiad.wmflabs using a documented process.
Deployed new service (526b7b1e90d3b32c65e1cc0cdc2cef2d71ffa2b0):
* Unify logging through the service wrapper
* Add a human-readable help page to quickly test/check the service
* Make sure the collection id is specific to the selected backend
* Ensure that default temp and output directories exist
* Use /etc/mw-collection-ocg.js configuration file if present.
 
Deployed new bundler (05a34aef7e31d8073471327b2cbff989a962257d):
* Use new log and status reporting framework
 
Deployed new latexer (c784b335525390b1da5d2f64a8503330175f08a3):
* Use new log and status reporting framework
 
Deployed new texter (c0360962459362e2de8cd2bbc44e7516a6037f9d):
* Use new log and status reporting framework
* Add -T option to CLI to specify a temporary directory
* Allow rendering from unzipped bundle
=== 2014-08-13 ===
ocg-collection:
* master: d7d1571d2bbe7da7c85f618f4eec3b0d8749c49e
* wmf-deploy: faee29a260a96cbc0cdc0d402658b754a7425af9
Deployed new bundler (e12b79121df18158403ca5f0b160fc95883d0ccc):
* Don't use process.exit on a normal successful exit (avoid truncating files)
* Sync output directories before bundling (avoid truncating files)
* Check for truncated image files during download (avoid truncating files)
Deployed new latexer (f90a3141367eddbc72f5a657fe45c5ebe5ee1c98):
* Allow page breaks between empty sections.
* Ensure latin font is used for list item bullets.
* Add Lohit fonts for Indic languages, and use them whenever possible (bug 28206, bug 68922)
Deployed new service (158d50bc9274ace22daaa76927e03c3ec6b1de71):
* Remove useless configuration variable.