The Wayback Machine - https://web.archive.org/web/20190530174455/https://phabricator.wikimedia.org/tag/postgresql/
Page MenuHomePhabricator

PostgreSQLTag
ActivePublic

Details

Description

Issues related to supporting the use of the PostgreSQL database back-end for MediaWiki.

Recent Activity

Yesterday

Ladsgroup added a comment to T191231: RFC: Abstract schemas and schema changes.

In the discussion with @daniel and @Anomie it become apparent that it's better to drop support for Oracle and MSSQL before trying to abstract it and moving support to extensions and if someone wants to maintain the support, they should do it in the extension.

Wed, May 29, 10:10 AM · Patch-For-Review, User-Addshore, Core Platform Team (Code Health (TEC13)), Core Platform Team Backlog (Epic), TechCom-RFC, SQLite, Oracle Database, MSSQL, PostgreSQL, MediaWiki-Database, Epic

Sat, May 25

ReleaseTaggerBot added projects to T222385: MediaWiki Resource Loader, upsert(), and PostgreSQL: deadlock issues: MW-1.31-release-notes, MW-1.30-release-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.33-notes, MW-1.32-notes.
Sat, May 25, 4:01 AM · MW-1.32-notes, MW-1.33-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.30-release-notes, MW-1.31-release-notes, Performance-Team, MediaWiki-ResourceLoader, PostgreSQL, MediaWiki-Database

Fri, May 24

IijimaYun added a comment to T222357: Cargo and PostgreSQL: schema problems and code issues.

By the way, I have another bug to report. This one I have not yet traced in the source (it is very hard to get it to actually happen and thus get a stack trace): unquoted column identifier for _pageID, once again.

Fri, May 24, 8:04 PM · PostgreSQL, MediaWiki-extensions-Cargo
gerritbot added a comment to T222385: MediaWiki Resource Loader, upsert(), and PostgreSQL: deadlock issues.

Change 512380 merged by jenkins-bot:
[mediawiki/core@REL1_33] resourceloader: Use AND instead of OR for upsert conds in saveFileDependencies()

Fri, May 24, 6:10 PM · MW-1.32-notes, MW-1.33-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.30-release-notes, MW-1.31-release-notes, Performance-Team, MediaWiki-ResourceLoader, PostgreSQL, MediaWiki-Database
Reedy closed T222385: MediaWiki Resource Loader, upsert(), and PostgreSQL: deadlock issues as Resolved.
Fri, May 24, 5:20 PM · MW-1.32-notes, MW-1.33-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.30-release-notes, MW-1.31-release-notes, Performance-Team, MediaWiki-ResourceLoader, PostgreSQL, MediaWiki-Database
gerritbot added a comment to T222385: MediaWiki Resource Loader, upsert(), and PostgreSQL: deadlock issues.

Change 512396 merged by jenkins-bot:
[mediawiki/core@REL1_31] resourceloader: Use AND instead of OR for upsert conds in saveFileDependencies()

Fri, May 24, 5:05 PM · MW-1.32-notes, MW-1.33-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.30-release-notes, MW-1.31-release-notes, Performance-Team, MediaWiki-ResourceLoader, PostgreSQL, MediaWiki-Database
gerritbot added a comment to T222385: MediaWiki Resource Loader, upsert(), and PostgreSQL: deadlock issues.

Change 512395 merged by jenkins-bot:
[mediawiki/core@REL1_32] resourceloader: Use AND instead of OR for upsert conds in saveFileDependencies()

Fri, May 24, 5:05 PM · MW-1.32-notes, MW-1.33-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.30-release-notes, MW-1.31-release-notes, Performance-Team, MediaWiki-ResourceLoader, PostgreSQL, MediaWiki-Database
gerritbot added a comment to T222385: MediaWiki Resource Loader, upsert(), and PostgreSQL: deadlock issues.

Change 512397 merged by Reedy:
[mediawiki/core@REL1_30] resourceloader: Use AND instead of OR for upsert conds in saveFileDependencies()

Fri, May 24, 4:47 PM · MW-1.32-notes, MW-1.33-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.30-release-notes, MW-1.31-release-notes, Performance-Team, MediaWiki-ResourceLoader, PostgreSQL, MediaWiki-Database
gerritbot added a comment to T222385: MediaWiki Resource Loader, upsert(), and PostgreSQL: deadlock issues.

Change 512397 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/core@REL1_30] resourceloader: Use AND instead of OR for upsert conds in saveFileDependencies()

Fri, May 24, 4:42 PM · MW-1.32-notes, MW-1.33-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.30-release-notes, MW-1.31-release-notes, Performance-Team, MediaWiki-ResourceLoader, PostgreSQL, MediaWiki-Database
gerritbot added a comment to T222385: MediaWiki Resource Loader, upsert(), and PostgreSQL: deadlock issues.

Change 512396 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/core@REL1_31] resourceloader: Use AND instead of OR for upsert conds in saveFileDependencies()

Fri, May 24, 4:42 PM · MW-1.32-notes, MW-1.33-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.30-release-notes, MW-1.31-release-notes, Performance-Team, MediaWiki-ResourceLoader, PostgreSQL, MediaWiki-Database
gerritbot added a comment to T222385: MediaWiki Resource Loader, upsert(), and PostgreSQL: deadlock issues.

Change 512395 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/core@REL1_32] resourceloader: Use AND instead of OR for upsert conds in saveFileDependencies()

Fri, May 24, 4:41 PM · MW-1.32-notes, MW-1.33-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.30-release-notes, MW-1.31-release-notes, Performance-Team, MediaWiki-ResourceLoader, PostgreSQL, MediaWiki-Database
gerritbot added a comment to T222385: MediaWiki Resource Loader, upsert(), and PostgreSQL: deadlock issues.

Change 512380 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/core@REL1_33] resourceloader: Use AND instead of OR for upsert conds in saveFileDependencies()

Fri, May 24, 2:55 PM · MW-1.32-notes, MW-1.33-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.30-release-notes, MW-1.31-release-notes, Performance-Team, MediaWiki-ResourceLoader, PostgreSQL, MediaWiki-Database
gerritbot added a comment to T222385: MediaWiki Resource Loader, upsert(), and PostgreSQL: deadlock issues.

Change 512301 merged by jenkins-bot:
[mediawiki/core@master] resourceloader: Use AND instead of OR for upsert conds in saveFileDependencies()

Fri, May 24, 1:37 PM · MW-1.32-notes, MW-1.33-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.30-release-notes, MW-1.31-release-notes, Performance-Team, MediaWiki-ResourceLoader, PostgreSQL, MediaWiki-Database
Krinkle triaged T222385: MediaWiki Resource Loader, upsert(), and PostgreSQL: deadlock issues as High priority.
Fri, May 24, 1:29 PM · MW-1.32-notes, MW-1.33-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.30-release-notes, MW-1.31-release-notes, Performance-Team, MediaWiki-ResourceLoader, PostgreSQL, MediaWiki-Database
Krinkle updated subscribers of T222385: MediaWiki Resource Loader, upsert(), and PostgreSQL: deadlock issues.

Thanks for the report @IijimaYun. I believe this bug was caused by e7b57d881a, first released in MW 1.29.

Fri, May 24, 1:28 PM · MW-1.32-notes, MW-1.33-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.30-release-notes, MW-1.31-release-notes, Performance-Team, MediaWiki-ResourceLoader, PostgreSQL, MediaWiki-Database
Reedy added a comment to T222385: MediaWiki Resource Loader, upsert(), and PostgreSQL: deadlock issues.

[11:17:22] <Remilia> Reedy: can confirm the patch totally fixes the deadlock issue, zero deadlock errors since I added it on the main wiki (11+ hours now) while the other, not patched yet, wikis get them (once a day since they are very low use)

Fri, May 24, 11:28 AM · MW-1.32-notes, MW-1.33-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.30-release-notes, MW-1.31-release-notes, Performance-Team, MediaWiki-ResourceLoader, PostgreSQL, MediaWiki-Database

Thu, May 23

gerritbot added a project to T222385: MediaWiki Resource Loader, upsert(), and PostgreSQL: deadlock issues: Patch-For-Review.
Thu, May 23, 11:18 PM · MW-1.32-notes, MW-1.33-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.30-release-notes, MW-1.31-release-notes, Performance-Team, MediaWiki-ResourceLoader, PostgreSQL, MediaWiki-Database
gerritbot added a comment to T222385: MediaWiki Resource Loader, upsert(), and PostgreSQL: deadlock issues.

Change 512301 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/core@master] Make md_module, md_skin a single unique index in ResourceLoaderModule::saveFileDependencies()

Thu, May 23, 11:18 PM · MW-1.32-notes, MW-1.33-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.30-release-notes, MW-1.31-release-notes, Performance-Team, MediaWiki-ResourceLoader, PostgreSQL, MediaWiki-Database
Reedy added a comment to T222385: MediaWiki Resource Loader, upsert(), and PostgreSQL: deadlock issues.

MySQL is doing (using dummy values)...

INSERT INTO `mw_module_deps` (md_module,md_skin,md_deps) VALUES ('skin name','vary','deps') ON DUPLICATE KEY UPDATE md_deps = 'deps'
Thu, May 23, 11:01 PM · MW-1.32-notes, MW-1.33-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.30-release-notes, MW-1.31-release-notes, Performance-Team, MediaWiki-ResourceLoader, PostgreSQL, MediaWiki-Database
Reedy updated subscribers of T222385: MediaWiki Resource Loader, upsert(), and PostgreSQL: deadlock issues.
Thu, May 23, 10:33 PM · MW-1.32-notes, MW-1.33-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.30-release-notes, MW-1.31-release-notes, Performance-Team, MediaWiki-ResourceLoader, PostgreSQL, MediaWiki-Database
Restricted Application added a project to T222385: MediaWiki Resource Loader, upsert(), and PostgreSQL: deadlock issues: Performance-Team.

Update: this seems to trigger DB server overload. Deadlock detection has timeouts and this leads to PostgreSQL reaching its connection limit (my max_connections is set to 1024 and it gets exhausted during massive user influx).
These hanging connections seem to lead to ResourceLoader actually failing to load CSS and JavaScript.

Thu, May 23, 7:27 PM · MW-1.32-notes, MW-1.33-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.30-release-notes, MW-1.31-release-notes, Performance-Team, MediaWiki-ResourceLoader, PostgreSQL, MediaWiki-Database

Wed, May 22

Yaron_Koren added a comment to T222357: Cargo and PostgreSQL: schema problems and code issues.

@IijimaYun - I'm sorry for the very long delay, and I'm sorry about all the problems. I assume that issue you had with "UNIQUE" is due to the fact that you have some template ("ShipMain", I guess) that declares more than one Cargo table. Which is fine - but it's rare, which is probably why this problem hasn't shown up before. I checked in to Cargo a fix to remove that "UNIQUE" restriction, as well as that strange "DEFAULT nextval()" thing. If you can do the same thing locally in your database, it should be fine. (You probably already have.)

Wed, May 22, 2:07 AM · PostgreSQL, MediaWiki-extensions-Cargo

Thu, May 16

Pasajeros added a comment to T185699: Extension:UserMerge - Database Error: "ERROR: relation "ignore" does not exist".

@siebrand , this UserMerge issue is specific to PostgreSQL; do you advice to migrate to MariaDB or wait for a fix?
I hope you can help.

Thu, May 16, 1:28 PM · PostgreSQL, MediaWiki-extensions-UserMerge

Thu, May 2

IijimaYun created T222385: MediaWiki Resource Loader, upsert(), and PostgreSQL: deadlock issues.
Thu, May 2, 5:39 PM · MW-1.32-notes, MW-1.33-notes, MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), MW-1.30-release-notes, MW-1.31-release-notes, Performance-Team, MediaWiki-ResourceLoader, PostgreSQL, MediaWiki-Database
Aklapper added a project to T222357: Cargo and PostgreSQL: schema problems and code issues: PostgreSQL.
Thu, May 2, 11:07 AM · PostgreSQL, MediaWiki-extensions-Cargo

Tue, Apr 30

Reedy merged T221496: 1.32's update.php is broken for PostgreSQL into T215169: Database::update() with IGNORE option fails on PostgreSQL (MW-1.32 migration error).
Tue, Apr 30, 10:30 PM · MW-1.32-notes, MW-1.31-release-notes, Core Platform Team Kanban (Done with CPT), MW-1.33-notes (1.33.0-wmf.19; 2019-02-26), Patch-For-Review, MW-1.33-release, MW-1.32-release, MW-1.31-release, MediaWiki-Database, PostgreSQL
Reedy merged task T221496: 1.32's update.php is broken for PostgreSQL into T215169: Database::update() with IGNORE option fails on PostgreSQL (MW-1.32 migration error).
Tue, Apr 30, 10:30 PM · MediaWiki-Installer, PostgreSQL

Apr 23 2019

CarlosRuiz added a comment to T221619: Error running update.php on shared db.

Thanks @Reedy , upgrade was from 1.27.1 to 1.32.1

Apr 23 2019, 1:52 PM · PostgreSQL, MediaWiki-Installer, MediaWiki-Maintenance-scripts
Reedy updated subscribers of T221619: Error running update.php on shared db.

Fixing part of this would also fix T221616: Error running update.php on shared db with PostgreSQL (at least where INSERT IGNORE is concerned)

Apr 23 2019, 12:27 PM · PostgreSQL, MediaWiki-Installer, MediaWiki-Maintenance-scripts
Reedy added a project to T221619: Error running update.php on shared db: PostgreSQL.
Apr 23 2019, 12:22 PM · PostgreSQL, MediaWiki-Installer, MediaWiki-Maintenance-scripts
Aklapper renamed T221616: Error running update.php on shared db with PostgreSQL from Error running update.php on shared db to Error running update.php on shared db with PostgreSQL.
Apr 23 2019, 12:10 PM · PostgreSQL, MediaWiki-extensions-UserMerge

Apr 22 2019

Aklapper added a comment to T221496: 1.32's update.php is broken for PostgreSQL.

Hacking the latter syntax into maintenance/populateExternallinksIndex60.php like so
allows the upgrade process to finish successfully.

Apr 22 2019, 9:58 PM · MediaWiki-Installer, PostgreSQL
Marostegui edited projects for T221541: Adding tags hstore GIN indexes to the OSM database on osmdb.eqiad.wmnet for performance, added: PostgreSQL; removed DBA.

OSM is PostreSQL which is not maintained by the DBA team.

Apr 22 2019, 1:00 PM · PostgreSQL, Cloud-Services, Maps (Maps-data)

Apr 20 2019

IijimaYun added projects to T221496: 1.32's update.php is broken for PostgreSQL: PostgreSQL, MediaWiki-Installer.
Apr 20 2019, 10:58 AM · MediaWiki-Installer, PostgreSQL

Apr 18 2019

matej_suchanek added a subtask for T199544: Make AbuseFilter work on PostgreSQL and SQLite (tracking): T221357: Read timeout reached while viewing AbuseLog.
Apr 18 2019, 5:59 PM · PostgreSQL, SQLite, AbuseFilter

Apr 15 2019

daniel closed T217607: MediaWikiTestCase::copyTestData does not work on Postgres and SQLite as Resolved.
Apr 15 2019, 3:10 PM · MW-1.33-notes (1.33.0-wmf.22; 2019-03-19), MediaWiki-Core-Testing, PostgreSQL, SQLite, Patch-For-Review, Core Platform Team Kanban (Doing), Core Platform Team (Code Health (TEC13))

Apr 13 2019

Daimona claimed T193068: Add support for SQLite and postgre when searching patterns.

Patch above + its dependencies and that's it.

Apr 13 2019, 9:36 AM · Patch-For-Review, AbuseFilter, PostgreSQL, SQLite
gerritbot added a project to T193068: Add support for SQLite and postgre when searching patterns: Patch-For-Review.
Apr 13 2019, 9:35 AM · Patch-For-Review, AbuseFilter, PostgreSQL, SQLite
gerritbot added a comment to T193068: Add support for SQLite and postgre when searching patterns.

Change 503562 had a related patch set uploaded (by Daimona Eaytoy; owner: Daimona Eaytoy):
[mediawiki/extensions/AbuseFilter@master] Make patterns searching compatible with Postgres and SQLite

Apr 13 2019, 9:35 AM · Patch-For-Review, AbuseFilter, PostgreSQL, SQLite

Apr 12 2019

Daimona closed T42757: Joins on INTEGER and TEXT fail with PostgreSQL as Resolved.

Calling this resolved because the compatibility problem with postgres is indeed resolved. I'm gonna open another task for the long-term goal of splitting afl_filter in afl_filter_id and afl_global.

Apr 12 2019, 7:35 AM · MW-1.34-notes (1.34.0-wmf.1; 2019-04-16), PostgreSQL, AbuseFilter
Daimona closed T42757: Joins on INTEGER and TEXT fail with PostgreSQL, a subtask of T2384: [REPLACED BY TAG] PostgreSQL/pgsql support (tracking), as Resolved.
Apr 12 2019, 7:35 AM · PostgreSQL, Tracking-Neverending, MediaWiki-Database
Daimona closed T42757: Joins on INTEGER and TEXT fail with PostgreSQL, a subtask of T199544: Make AbuseFilter work on PostgreSQL and SQLite (tracking), as Resolved.
Apr 12 2019, 7:34 AM · PostgreSQL, SQLite, AbuseFilter

Apr 11 2019

ReleaseTaggerBot added a project to T42757: Joins on INTEGER and TEXT fail with PostgreSQL: MW-1.34-notes (1.34.0-wmf.1; 2019-04-16).
Apr 11 2019, 10:00 PM · MW-1.34-notes (1.34.0-wmf.1; 2019-04-16), PostgreSQL, AbuseFilter
gerritbot added a comment to T42757: Joins on INTEGER and TEXT fail with PostgreSQL.

Change 468706 merged by jenkins-bot:
[mediawiki/extensions/AbuseFilter@master] Use string cast for Postgres compatibility

Apr 11 2019, 9:50 PM · MW-1.34-notes (1.34.0-wmf.1; 2019-04-16), PostgreSQL, AbuseFilter

Apr 8 2019

BPirkle created T220450: Make Postgres search use a searchindex table.
Apr 8 2019, 9:04 PM · PostgreSQL, MediaWiki-Database, Multi-Content-Revisions (Tech Debt), Technical-Debt

Apr 5 2019

Krinkle moved T217607: MediaWikiTestCase::copyTestData does not work on Postgres and SQLite from Inbox to PHPUnit on the MediaWiki-Core-Testing board.
Apr 5 2019, 3:51 PM · MW-1.33-notes (1.33.0-wmf.22; 2019-03-19), MediaWiki-Core-Testing, PostgreSQL, SQLite, Patch-For-Review, Core Platform Team Kanban (Doing), Core Platform Team (Code Health (TEC13))

Mar 30 2019

Ladsgroup added a comment to T191231: RFC: Abstract schemas and schema changes.

@Ladsgroup Did you check how DBAL holds up against the heap of nasty edge cases that @Anomie compiled? https://www.mediawiki.org/wiki/User:Anomie/Abstract_schema/DB_Requirements

Mar 30 2019, 4:54 PM · Patch-For-Review, User-Addshore, Core Platform Team (Code Health (TEC13)), Core Platform Team Backlog (Epic), TechCom-RFC, SQLite, Oracle Database, MSSQL, PostgreSQL, MediaWiki-Database, Epic

Mar 29 2019

gerritbot added a comment to T42757: Joins on INTEGER and TEXT fail with PostgreSQL.

Change 488477 abandoned by Daimona Eaytoy:
Read afl_filter_id and afl_global instead of afl_filter

Mar 29 2019, 1:32 PM · MW-1.34-notes (1.34.0-wmf.1; 2019-04-16), PostgreSQL, AbuseFilter

Mar 28 2019

daniel added a comment to T191231: RFC: Abstract schemas and schema changes.

@Ladsgroup Did you check how DBAL holds up against the heap of nasty edge cases that @Anomie compiled? https://www.mediawiki.org/wiki/User:Anomie/Abstract_schema/DB_Requirements

Mar 28 2019, 8:54 PM · Patch-For-Review, User-Addshore, Core Platform Team (Code Health (TEC13)), Core Platform Team Backlog (Epic), TechCom-RFC, SQLite, Oracle Database, MSSQL, PostgreSQL, MediaWiki-Database, Epic
gerritbot added a comment to T42757: Joins on INTEGER and TEXT fail with PostgreSQL.

Change 488477 had a related patch set uploaded (by Daimona Eaytoy; owner: Daimona Eaytoy):
[mediawiki/extensions/AbuseFilter@master] Read afl_filter_id and afl_global instead of afl_filter

Mar 28 2019, 6:40 PM · MW-1.34-notes (1.34.0-wmf.1; 2019-04-16), PostgreSQL, AbuseFilter
Morty Proxy This is a proxified and sanitized view of the page, visit original site.