870962 - showing only first 500 results breaks use case for large buglists

Status: NEW

(Bugzilla :: Query/Bug List, defect)

Description

[Asa Dotzler [:asa]]

Large bug queries, of the format https://bugzilla.mozilla.org/buglist.cgi?bug_id=<large list of comma separated bug IDs> will fail because of a URL GET length limit and this was worked around by making query.cgi do a POST if it had too big of a list in the "Bugs numbered" field. Now that's broken because I submit >500 lists of IDs and then when I get only the first 500 in my results and ask for all of them, that uses GET again instead of POST so I hit the URL length limit again. 

If a user enters a list of bug IDs in the "Bugs numbered" field, he does not want that list artificially truncated, ever. This use case regression was introduced by the fix to bug 632718. It's made Bugzilla almost useless for working with long bug lists. 

Can we have the enable limiting to 500 as an option on the query page? We can have it enabled by default for the casual user, while still empowering folks like me to do their job without resorting to lots of smaller queries that are difficult to combine. 

To test this out, follow these steps. 

1. visit the advanced query page. 
2. clear all fields.
3. paste the sample list of bug numbers (or any list of approximately 900 six-digit bugs) into the field labeled "Bugs numbered"
4. submit query.
5. click the "See all search results from this query" link
6. fail with URL length limit exceeded.

Here's a sample list, in case you want something easy to copy and paste.  

49976,57652,68784,80163,97163,125082,151407,224315,231172,248808,303505,324378,327598,328885,331105,338033,338427,343515,368106,369180,375003,394144,395609,398825,418615,420371,425561,429023,431048,431217,436265,436801,440590,446041,448945,451286,459439,462463,462758,465731,473236,485149,507103,507622,509272,520992,523796,525444,530352,533315,539427,541918,549697,559764,560072,575431,579517,581352,583976,586067,586125,587757,588305,595104,595351,597064,600100,600307,601442,602814,617897,618485,620145,628785,630197,636564,637675,638953,640225,645350,645402,646597,648407,648980,649216,651317,652301,653001,655322,662008,664688,666801,667243,670603,672811,673875,674212,675198,676421,677452,677716,677930,677962,677991,678031,678377,678392,678559,678743,679364,685471,685652,687086,688400,688401,688691,689870,690446,690938,691096,691613,691647,692894,694196,697319,699331,701353,701504,703377,703514,703564,704063,708814,711846,715746,716482,716716,717546,717637,719271,722888,723069,723163,723923,724368,724533,725771,726605,727697,729463,729519,730424,730441,730445,731491,731746,733632,733642,733712,734550,734691,735129,736592,738818,739031,739417,740256,740541,742206,742537,742902,743158,744741,744836,745154,745919,746983,748495,748851,748894,749086,752516,753453,753984,754356,755240,756067,757351,757897,758288,758437,758872,759906,761442,762258,763698,763890,763943,764638,765155,765432,765780,766583,767710,768288,769871,770626,771458,772119,773535,774365,775776,775924,776027,776212,777144,777379,777548,777681,777877,777964,777975,778216,778459,779291,779336,779898,780741,781702,781971,782091,782506,782671,782714,782728,783187,783359,783402,783423,783425,783429,783432,783439,783440,783445,783471,783499,783626,783657,783661,784000,784006,784046,784051,784170,784387,784469,784474,784484,784489,784548,784573,785468,786235,786539,786999,787155,788022,788613,788866,789363,789593,789897,789980,790325,790732,791913,792077,792215,792815,792920,793735,793747,794410,795495,795588,796005,796048,797970,798165,798172,798226,798358,798535,798844,799089,799147,799172,799308,799816,800220,800805,800899,800996,801758,802240,802454,802776,803719,804144,804676,804742,805121,805877,805913,805917,806046,806271,806415,806568,807678,807699,807715,808045,808061,808369,808370,808519,808596,808659,809171,809201,809273,809338,809424,809430,809558,809733,810091,810285,810373,810375,810454,810603,810644,810675,810763,810824,810946,810962,810970,811042,811167,811307,811314,811403,811875,812138,812265,812291,812596,813288,813418,813567,813569,813606,813725,813756,813955,814037,814061,814136,814179,814419,814587,814956,815110,815700,815715,815905,816015,816021,816053,816257,816493,816959,816967,816973,816985,817107,817515,817533,817578,817586,817626,817972,818042,818083,818115,818134,818231,818480,818528,818655,818675,818889,818927,818940,818960,819005,819369,819493,819734,819954,820012,820022,820105,820152,820159,820170,820406,820569,820846,821268,821315,821682,821692,821877,822041,822208,822219,822222,822265,822431,822657,822744,822989,823230,823375,823465,823482,823803,824164,824338,824642,824963,824965,825012,825110,825608,825928,826058,826093,826262,826357,826556,826647,826683,826691,826740,827104,827248,827490,827684,828051,828325,828500,828563,829056,829419,829456,829868,829872,830100,830197,830347,830430,830492,830505,830885,830935,830942,831107,831400,831514,831720,831754,831768,831916,831918,831998,832034,832091,832231,832373,832383,832400,832524,832672,832848,832946,833215,833286,833765,833964,833965,833971,834034,834270,834370,834513,834699,834707,834835,834836,835255,835277,835456,835610,835643,835716,835802,835832,835919,835930,835973,835999,836005,836064,836078,836132,836255,836263,836347,836349,836373,836396,836404,836452,836466,836486,836493,836565,836568,836688,836720,836723,836742,836781,836869,836949,836953,836987,837008,837035,837051,837132,837197,837312,837323,837351,837359,837390,837409,837498,837618,837628,837639,837643,837679,837723,837747,837941,837950,838038,838088,838109,838136,838200,838239,838319,838321,838336,838361,838368,838380,838385,838467,838520,838530,838534,838535,838670,838705,838727,838793,838802,838805,838820,838862,839037,839080,839115,839172,839206,839228,839258,839280,839303,839305,839335,839383,839425,839434,839467,839501,839515,839516,839596,839639,839641,839767,839788,839831,839836,839841,839855,839865,839907,839956,839957,839982,840012,840066,840093,840140,840162,840244,840285,840292,840315,840388,840417,840505,840551,840569,840576,840580,840612,840722,840881,840921,840984,841058,841126,841129,841192,841228,841285,841343,841363,841429,841469,841488,841495,841516,841535,841554,841718,841759,841762,841765,841805,841876,841941,841967,842013,842130,842224,842264,842313,842319,842326,842429,842430,842431,842432,842444,842481,842540,842611,842633,842780,842852,842887,842889,842927,843005,843187,843264,843273,843287,843324,843429,843445,843483,843492,843559,843596,843721,843793,843811,843854,843865,843886,843907,843917,844016,844031,844178,844227,844246,844253,844295,844323,844383,844462,844464,844467,844469,844470,844490,844515,844549,844573,844655,844693,844705,844779,844816,844828,844887,844928,844996,845023,845151,845182,845187,845331,845357,845362,845555,845596,845681,845707,845713,845741,845771,845862,845866,845873,845925,845948,846072,846110,846111,846122,846137,846175,846259,846275,846296,846297,846360,846363,846424,846531,846540,846551,846603,846606,846634,846648,846658,846733,846737,846848,846862,846864,846881,846893,846906,846967,846973,846995,847094,847125,847191,847194,847205,847211,847255,847259,847267,847279,847349,847352,847354,847410,847425,847446,847484,847596,847597,847598,847621,847655,847656,847678,847728,847741,847744,847779,847786,847789,847790,847834,847837,847867,847872,847898,847981,847983,848122,848155,848171,848237,848267,848291,848293,848297,848374,848385,848414,848481,848489,848490,848519,848560,848652,848679,848719,848743,848764,848792,848849,848935,848961,848973,849069,849071,849157,849185,849239,849270,849364,849394,849398,849399,849500,849526,849589,849597,849624,849647,849654,849714,849739,849764,849810,849847,849909,849996,850074,850090,850099,850127,850150,850157,850163,850210,850213,850214,850217,850252,850253,850275,850302,850332,850362

Comment 1

[Frédéric Buclin]

It's pretty uncommon to paste or type 500+ bug IDs in the "Bugs numbered" field. How do you generate such lists?

Anyway, I think the right fix is to ignore the 500 bugs limit when a list of bug IDs is passed. Simply list all bugs in the list.

Comment 2

[Asa Dotzler [:asa]]

I do this all the time :)  I scrape bug lists from http://hg.mozilla.org queries or from other bug queries.

Comment 3

[David Lawrence [:dkl]]

(In reply to Asa Dotzler [:asa] from comment #2)
> I do this all the time :)  I scrape bug lists from http://hg.mozilla.org
> queries or from other bug queries.

You can also pass &limit=0 in the URL which return all bugs, no just 500.

But I agree that when passing in one or more valid bug ids, we should ignore the 500 limit.

dkl

Comment 4

[Asa Dotzler [:asa]]

(In reply to David Lawrence [:dkl] from comment #3)
> (In reply to Asa Dotzler [:asa] from comment #2)
> > I do this all the time :)  I scrape bug lists from http://hg.mozilla.org
> > queries or from other bug queries.
> 
> You can also pass &limit=0 in the URL which return all bugs, no just 500.


As far as I can tell, this isn't possible. Bugzilla's query page does a POST for long buglists so there's no URL to append anything to.  

If I'm missing a simple workaround please explain precisely how and I'll stop wasting hours of my time trying to work with buglists like I used to be able to before this update broke Bugzilla for me.

Comment 5

[:glob ✱]

the core issue here is bug 774194, however the fix in comment 1 makes sense so i'll leave this bug unduplicated.

Comment 6

[Jesse Ruderman]

Asa, two workarounds for you:

(A) Paste lists of bug numbers into http://www.squarefree.com/bugzilla/bug-list-munger.html and click "POST".

(B) On the query page, run this before submitting the form:

document.forms.queryform.insertAdjacentHTML('beforeend', '<input type=hidden name=limit value=0>');

I could also make a workaround for bug 774194 but it would probably be more work than fixing it.