Closed Bug 1600467 Opened 5 years ago Closed 5 years ago

Version 71.0+build2-0ubuntu0.16.04.1 cannot execute. 100% crash

Categories

(Core :: Graphics: WebRender, defect)

Product:
Core
Component:
Graphics: WebRender
Version:
71 Branch
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

()

Status:
RESOLVED DUPLICATE of bug 1594686

People

(Reporter: mwinthrop, Unassigned)

References

Details

User Agent: Mozilla/5.0 (Windows NT 5.1; WOW64; rv:52.0) Gecko/20100101 Firefox/52.0

Steps to reproduce:

I used sudo apt purge for installed firefox (71.0+build2-0ubuntu0.16.04.1) in the computer.
then "sudo apt update"
then "sudo apt upgrade"
I then did a "sudo apt clean:,
then "sudo apt autoremove".
I then did an install: "sudo apt-get install --install-suggests firefox"
nojoy.
I tried replying to the auto crash report. nojoy.

NOTE:
I am submitting this report using Linux Wine version 52 of Firefox, which still works but is limited right now from updates because I need to tell wine this program can run under win 8 rules.

Actual results:

Crashes every time. sends report every time.

crash report says:
AdapterDeviceID: 0x2a42
AdapterDriverVendor: mesa/i965
AdapterDriverVersion: 18.0.5.0
AdapterVendorID: 0x8086
Add-ons: adblockultimate%40adblockultimate.net:2.41,jid1-q4sG8pYhq8KGHs%40jetpack:0.3.2,YoutubeDownloader%40PeterOlayev.com:4.0.92,CookieAutoDelete%40kennydo.com:3.0.2,https-everywhere%40eff.org:2019.11.7,%7B6d854c02-e0bc-4975-a153-3eacf6021131%7D:1.0.2,jid1-KKzOGWgsW3Ao4Q%40jetpack:3.0.7,%7Bc3c10168-4186-445c-9c5b-63f12b8e2c87%7D:1.9.0,bookmarksorganizer%40agenedia.com:3.1.0,formautofill%40mozilla.org:1.0,screenshots%40mozilla.org:39.0.0,webcompat%40mozilla.org:6.4.0,default-theme%40mozilla.org:1.0,google%40search.mozilla.org:1.0,amazondotcom%40search.mozilla.org:1.1,bing%40search.mozilla.org:1.0,ddg%40search.mozilla.org:1.0,ebay%40search.mozilla.org:1.0,twitter%40search.mozilla.org:1.0,wikipedia%40search.mozilla.org:1.0,langpack-en-CA%40firefox.mozilla.org:71.0,langpack-en-GB%40firefox.mozilla.org:71.0
BuildID: 20191126111938
ContentSandboxCapabilities: 119
ContentSandboxCapable: 1
ContentSandboxLevel: 4
CrashTime: 1575153616
DOMIPCEnabled: 1
Email: mwinthrop@comcast.net
FramePoisonBase: 9223372036600930304
FramePoisonSize: 4096
InstallTime: 1575058420
IsWayland: 0
IsWaylandDRM: 0
MozCrashReason: MOZ_RELEASE_ASSERT(len.isValid()) (Substring tuple length is invalid)
Notes: Ubuntu 16.04.6 LTSFP(D00-L1000-W00000000-T000) WR? WR- OMTP? OMTP+1
ProductID: {ec8030f7-c20a-464f-9b0e-13a3a9e97384}
ProductName: Firefox
ReleaseChannel: release
SafeMode: 0
SecondsSinceLastCrash: 204
StartupCrash: 0
StartupTime: 1575153614
TelemetryEnvironment: {"build":{"applicationId":"{ec8030f7-c20a-464f-9b0e-13a3a9e97384}","applicationName":"Firefox","architecture":"x86-64","buildId":"20191126111938","version":"71.0","vendor":"Mozilla","displayVersion":"71.0","platformVersion":"71.0","xpcomAbi":"x86_64-gcc3","updaterAvailable":false},"partner":{"distributionId":null,"distributionVersion":null,"partnerId":null,"distributor":null,"distributorChannel":null,"partnerNames":[]},"system":{"memoryMB":5922,"virtualMaxMB":null,"cpu":{"count":2,"cores":2,"vendor":"GenuineIntel","family":6,"model":23,"stepping":10,"l2cacheKB":1024,"l3cacheKB":1024,"speedMHz":2100,"extensions":["hasMMX","hasSSE","hasSSE2","hasSSE3","hasSSSE3"]},"os":{"name":"Linux","version":"4.15.0-70-generic","locale":"en-US"},"hdd":{"profile":{"model":null,"revision":null,"type":null},"binary":{"model":null,"revision":null,"type":null},"system":{"model":null,"revision":null,"type":null}},"gfx":{"D2DEnabled":null,"DWriteEnabled":null,"ContentBackend":"Skia","Headless":false,"adapters":[{"description":"Mesa DRI Mobile Intel® GM45 Express Chipset ","vendorID":"0x8086","deviceID":"0x2a42","subsysID":null,"RAM":1536,"driver":null,"driverVendor":"mesa/i965","driverVersion":"18.0.5.0","driverDate":null,"GPUActive":true}],"monitors":[{"screenWidth":1366,"screenHeight":768}],"features":{"compositor":"none","gpuProcess":{"status":"unavailable"},"wrQualified":{"status":"blocked-device-too-old"},"webrender":{"status":"opt-in"}}},"appleModelId":null},"settings":{"blocklistEnabled":true,"e10sEnabled":true,"e10sMultiProcesses":8,"telemetryEnabled":false,"locale":"en-US","intl":{},"update":{"channel":"release","enabled":true,"autoDownload":false},"userPrefs":{"app.shield.optoutstudies.enabled":false,"browser.cache.disk.capacity":860160,"browser.search.region":"US","browser.search.suggest.enabled":false,"browser.search.widget.inNavBar":true,"privacy.donottrackheader.enabled":true},"sandbox":{"effectiveContentProcessLevel":4},"addonCompatibilityCheckEnabled":true,"isDefaultBrowser":null},"profile":{}}
ThreadIdNameMapping: 17188:"Gecko_IOThread",17189:"JS Watchdog",17192:"Timer",17191:"JS Helper",17193:"Netlink Monitor",17190:"JS Helper",17194:"Socket Thread",17200:"StreamTrans #1",17201:"Cache2 I/O",17202:"Cookie",17208:"GMPThread",17209:"Worker Launcher",17210:"SoftwareVsyncThread",17211:"Compositor",17212:"ImgDecoder #1",17213:"ImageIO",17214:"IPDL Background",17217:"ImageBridgeChild",17218:"DOM Worker",17219:"StreamTrans #2",17220:"QuotaManager IO",17221:"IndexedDB #1",
Throttleable: 1
UptimeTS: 1.722229
Vendor: Mozilla
Version: 71.0
useragent_locale: en-US

This report also contains technical information about the state of the application when it crashed.

No crash report in /var/crash

Expected results:

normal browser opening

from command line:
dad@dad314159:$ firefox help
ExceptionHandler::GenerateDump cloned child 19635
ExceptionHandler::SendContinueSignalToChild sent continue signal to child
ExceptionHandler::WaitForContinueSignal waiting for continue signal...
dad@dad314159:$ Failed to open curl lib from binary, use libcurl.so instead

See Also: → 1594686

Bugbug thinks this bug should belong to this component, but please revert this change in case of error.

Component: Untriaged → Graphics: WebRender
Product: Firefox → Core

Looked at 1594686. Might be something Mozilla should consider. My issue is caused by the Mozilla "sudo apt update" build. I do not build my own Firefox releases.
"Failed to open curl lib from binary, use libcurl.so instead"
Seems that the significant referenced lib (curl lib) is not included in the current update package. Linux libcurl on version 16.04.1 does not work.

I am working on this forum via wine Firefox version 52.

We don't build the firefox that ubuntu ships, but we should certainly look into this.

Can you give us some crash ids? They're the names of the files inside ~/.mozilla/firefox/Crash Reports/submitted (or /pending, maybe, if they didn't manage to get sent).

Flags: needinfo?(mwinthrop)

Hopefully they are sent and we can debug from there, otherwise you probably need to jump into gdb and see what is crashing.

I see it is crashing in here from that report, though hard to see what calls into it... Furthermore it seems that code is dead in trunk...

Does firefox --safe-mode start up?

Looking at the crash statistics there are a few of those crashes, but none of them have usable stacks.

If safe mode doesn't work, does a build from here work? https://ftp.mozilla.org/pub/firefox/releases/71.0b12/linux-x86_64/en-US/firefox-71.0b12.tar.bz2

If so this probably has to do with Ubuntu :/

I purged firefox 71 so the reports were wiped with ~/mozilla.

The reports were sent when the crashes were happening according to the crash reporting window.

I saw that version 71 is disruptive, and looked at https://libre-software.net/how-to-install-firefox-on-ubuntu-linux-mint/.

I then downloaded and installed Firefox from firefox-70.0.1.tar.bz2. This is how I am now communicating. I did try "firefox --safe-mode" before the purge. Had the exact same crash. Thought I MIGHT try a build on this old Dell PC, then though better of it.

Flags: needinfo?(mwinthrop)

(In reply to Emilio Cobos Álvarez (:emilio) from comment #6)

Furthermore it seems that code is dead in trunk...
It seems I was wrong about this btw, this is used in template soup...

(In reply to Michael F Winthrop from comment #8)

I purged firefox 71 so the reports were wiped with ~/mozilla.
Ouch, that's unfortunate.
The reports were sent when the crashes were happening according to the crash reporting window.
Cool, thanks

I saw that version 71 is disruptive, and looked at https://libre-software.net/how-to-install-firefox-on-ubuntu-linux-mint/.

Thing is, it seems FF71 isn't officially released yet, so this is an Ubuntu build thingie.

I then downloaded and installed Firefox from firefox-70.0.1.tar.bz2. This is how I am now communicating. I did try "firefox --safe-mode" before the purge. Had the exact same crash. Thought I MIGHT try a build on this old Dell PC, then though better of it.

Ok, that's good to know, thank you!

Gabriele, it seems there's a whole lot of these crashes. They all seem from ubuntu, and without usable symbols... Do you know if your scripts could help to get a usable stack? Though it sounds likely it's just a bad build on ubuntu's side :/

Flags: needinfo?(gsvelto)

Ah, looks like somebody in the ubuntu-bugs list dug on gdb: https://www.mail-archive.com/ubuntu-bugs@lists.ubuntu.com/msg5675003.html. So it looks like:

  • This is not an stable package, but a firefox-next repo, so probably not all our ubuntu users are affected.
  • From that stack, it looks like a miscompilation, sigh :/

So not sure how actionable is this?

Ah, they're using clang 6 to build Firefox, that's known to miscompile at explained in bug 1594686.

Status: UNCONFIRMED → RESOLVED
Closed: 5 years ago
Resolution: --- → DUPLICATE

(Cancelling ni? based on the above)

Flags: needinfo?(gsvelto)

bug 1600467 Closed then? Perhaps Mozilla will recompile, correcting per solution to bug 1594686? Firefox version I am using could not use profile from dead and purged Version 71. Lost much history and bookmarks. Put new version in /opt/firefox70/ and started a new profile. might re-install broken 71 but concerned the version 70 I am now in will get clobbered. Any advice?

(In reply to Michael F Winthrop from comment #13)

bug 1600467 Closed then? Perhaps Mozilla will recompile, correcting per solution to bug 1594686? Firefox version I am using could not use profile from dead and purged Version 71. Lost much history and bookmarks. Put new version in /opt/firefox70/ and started a new profile. might re-install broken 71 but concerned the version 70 I am now in will get clobbered. Any advice?

The issue is that that build is not done by Mozilla, but by Ubuntu. So it is ubuntu who needs to patch their builds, or ship official Mozilla builds.

Regarding your profile: Do a backup, then try MOZ_ALLOW_DOWNGRADE=1 firefox -P (with an older firefox).

If that doesn't work, just install 71 beta from the link in comment 7, and use it until ubuntu fixes the package? That build should be ok, it's the Mozilla one (not the Ubuntu one), plus I just tried it :)

I posted this bug report to Ubuntu. I will wait for Ubuntu update and use Firefox 70 for now. I reinstalled Firefox 71 (still broken) and considered the variable "MOZ_ALLOW_DOWNGRADE=1 firefox -P" fix. Warnings abound that I might trash things that concern me. I will just be patient. Many thanks for your efforts to ID the source of this problem. Ball is in Ubuntu's court now.

(In reply to Michael F Winthrop from comment #15)

I posted this bug report to Ubuntu. I will wait for Ubuntu update and use Firefox 70 for now. I reinstalled Firefox 71 (still broken) and considered the variable "MOZ_ALLOW_DOWNGRADE=1 firefox -P" fix. Warnings abound that I might trash things that concern me. I will just be patient. Many thanks for your efforts to ID the source of this problem. Ball is in Ubuntu's court now.

Michael, you installed firefox from https://launchpad.net/~ubuntu-mozilla-security/+archive/ubuntu/ppa, which is meant exclusively for pre-release testing, not for end users. The PPA description says:

Staging PPA for Mozilla and other browser-related security updates.
Unless you are testing updates, you should NOT install packages from this PPA.

I am working on the issue (see https://bugzilla.mozilla.org/show_bug.cgi?id=1594686#c9). Whenever a working build is available, it will be pushed as an update to the Ubuntu archive. In the meantime, you should stay with firefox 70.0.1 or use the upstream builds provided by Mozilla. And I strongly suggest removing that PPA from your sources.

(In reply to Emilio Cobos Álvarez (:emilio) from comment #9)

Gabriele, it seems there's a whole lot of these crashes. They all seem from ubuntu, and without usable symbols... Do you know if your scripts could help to get a usable stack? Though it sounds likely it's just a bad build on ubuntu's side :/

As per the discussion here and in the other bug we don't have symbols for those builds because they're not part of the stable builds that ship with Ubuntu. I could add those to the list of packages we scrape but I'm not sure if it would be valuable to do so.

My thanks to everyone for this help. Actually I do not know how this build got to me. I looked at my ppa's and there is a very suspicious one for firefox. This ppa is used, per the mess below.
/etc/apt/sources.list.d/mozillateam-ubuntu-firefox-next-xenial.list:deb http://ppa.launchpad.net/mozillateam/firefox-next/ubuntu xenial main

I provided this to Ubuntu also. The first part of the info below is per their request, the last two list the apt install logs and ppa's used by apt.

I do not recall changing the firefox repository, so I probably should remove what I extracted above. I could not find https://launchpad.net/~ubuntu-mozilla-security/+archive/ubuntu/ppa in this list.

dad@dad314159:~$ uname -a
Linux dad314159 4.15.0-70-generic #79~16.04.1-Ubuntu SMP Tue Nov 12 14:01:10 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
dad@dad314159:~$ lsb_release -crid
Distributor ID: Ubuntu
Description:    Ubuntu 16.04.6 LTS
Release:        16.04
Codename:       xenial
dad@dad314159:~$ sudo apt-cache policy firefox
[sudo] password for dad: 
firefox:
  Installed: 71.0+build2-0ubuntu0.16.04.1
  Candidate: 71.0+build2-0ubuntu0.16.04.1
  Version table:
 *** 71.0+build2-0ubuntu0.16.04.1 500
        500 http://ppa.launchpad.net/ubuntu-mozilla-security/ppa/ubuntu xenial/main amd64 Packages
        100 /var/lib/dpkg/status
     71.0~b12+build1-0ubuntu0.16.04.1 500
        500 http://ppa.launchpad.net/mozillateam/firefox-next/ubuntu xenial/main amd64 Packages
     70.0.1+build1-0ubuntu0.16.04.1 500
        500 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages
        500 http://security.ubuntu.com/ubuntu xenial-security/main amd64 Packages
     45.0.2+build1-0ubuntu1 500
        500 http://us.archive.ubuntu.com/ubuntu xenial/main amd64 Packages
dad@dad314159:~$ less /var/log/apt/history.log
===============================================================
dad@dad314159:~$ cat /var/log/apt/history.log | grep firefox
Upgrade: python-psutil:amd64 (3.4.2-1, 3.4.2-1ubuntu0.1), libnss3-tools:amd64 (2:3.28.4-0ubuntu0.16.04.6, 2:3.28.4-0ubuntu0.16.04.8), rustc:amd64 (1.36.0+dfsg1+llvm-2ubuntu1~16.04.1, 1.37.0+dfsg1+llvm-1ubuntu1~16.04.1), libnss3-nssdb:amd64 (2:3.28.4-0ubuntu0.16.04.6, 2:3.28.4-0ubuntu0.16.04.8), ruby2.3:amd64 (2.3.1-2~ubuntu16.04.13, 2.3.1-2~ubuntu16.04.14), python3-psutil:amd64 (3.4.2-1, 3.4.2-1ubuntu0.1), libstd-rust-dev:amd64 (1.36.0+dfsg1+llvm-2ubuntu1~16.04.1, 1.37.0+dfsg1+llvm-1ubuntu1~16.04.1), amd64-microcode:amd64 (3.20191021.1ubuntu0.16.04.1, 3.20191021.1+really3.20180524.1~ubuntu0.16.04.2), libnss3-1d:amd64 (2:3.28.4-0ubuntu0.16.04.6, 2:3.28.4-0ubuntu0.16.04.8), ruby2.3-dev:amd64 (2.3.1-2~ubuntu16.04.13, 2.3.1-2~ubuntu16.04.14), rust-gdb:amd64 (1.36.0+dfsg1+llvm-2ubuntu1~16.04.1, 1.37.0+dfsg1+llvm-1ubuntu1~16.04.1), python-psutil-doc:amd64 (3.4.2-1, 3.4.2-1ubuntu0.1), libruby2.3:amd64 (2.3.1-2~ubuntu16.04.13, 2.3.1-2~ubuntu16.04.14), firefox-locale-en:amd64 (70.0.1+build1-0ubuntu0.16.04.1, 71.0+build2-0ubuntu0.16.04.1), cargo:amd64 (0.37.0-3ubuntu1~16.04.2, 0.38.0-0ubuntu1~16.04.1), debootstrap:amd64 (1.0.78+nmu1ubuntu1.9, 1.0.78+nmu1ubuntu1.10), libnss3:amd64 (2:3.28.4-0ubuntu0.16.04.6, 2:3.28.4-0ubuntu0.16.04.8), firefox:amd64 (70.0.1+build1-0ubuntu0.16.04.1, 71.0+build2-0ubuntu0.16.04.1), libnss3-dev:amd64 (2:3.28.4-0ubuntu0.16.04.6, 2:3.28.4-0ubuntu0.16.04.8), ruby2.3-tcltk:amd64 (2.3.1-2~ubuntu16.04.13, 2.3.1-2~ubuntu16.04.14)
Commandline: apt-get install --reinstall --install-suggests firefox
Reinstall: firefox:amd64 (71.0+build2-0ubuntu0.16.04.1)
Commandline: apt-get purge firefox
Purge: firefox:amd64 (71.0+build2-0ubuntu0.16.04.1)
Commandline: apt-get install --reinstall --install-suggests firefox
Install: firefox:amd64 (71.0+build2-0ubuntu0.16.04.1)
Commandline: apt-get purge firefox
Purge: firefox:amd64 (71.0+build2-0ubuntu0.16.04.1)
Commandline: apt-get install --reinstall --install-suggests firefox
Install: firefox:amd64 (71.0+build2-0ubuntu0.16.04.1)
Commandline: apt-get build-dep firefox
Commandline: apt remove firefox
Remove: firefox:amd64 (71.0+build2-0ubuntu0.16.04.1)
Commandline: apt install firefox
Install: firefox:amd64 (71.0+build2-0ubuntu0.16.04.1)
===============================================================
dad@dad314159:~$ grep ^[^#] /etc/apt/sources.list /etc/apt/sources.list.d/*
/etc/apt/sources.list:deb http://us.archive.ubuntu.com/ubuntu/ xenial main restricted
/etc/apt/sources.list:deb-src http://us.archive.ubuntu.com/ubuntu/ xenial multiverse main universe restricted #Added by software-properties
/etc/apt/sources.list:deb http://us.archive.ubuntu.com/ubuntu/ xenial-updates main restricted
/etc/apt/sources.list:deb-src http://us.archive.ubuntu.com/ubuntu/ xenial-updates multiverse main universe restricted #Added by software-properties
/etc/apt/sources.list:deb http://us.archive.ubuntu.com/ubuntu/ xenial universe
/etc/apt/sources.list:deb http://us.archive.ubuntu.com/ubuntu/ xenial-updates universe
/etc/apt/sources.list:deb http://us.archive.ubuntu.com/ubuntu/ xenial multiverse
/etc/apt/sources.list:deb http://us.archive.ubuntu.com/ubuntu/ xenial-updates multiverse
/etc/apt/sources.list:deb http://us.archive.ubuntu.com/ubuntu/ xenial-backports main restricted universe multiverse
/etc/apt/sources.list:deb-src http://us.archive.ubuntu.com/ubuntu/ xenial-backports main restricted universe multiverse #Added by software-properties
/etc/apt/sources.list:deb http://archive.canonical.com/ubuntu xenial partner
/etc/apt/sources.list:deb http://security.ubuntu.com/ubuntu xenial-security main restricted
/etc/apt/sources.list:deb-src http://security.ubuntu.com/ubuntu xenial-security multiverse main universe restricted #Added by software-properties
/etc/apt/sources.list:deb http://security.ubuntu.com/ubuntu xenial-security universe
/etc/apt/sources.list:deb http://security.ubuntu.com/ubuntu xenial-security multiverse
/etc/apt/sources.list:deb http://download.virtualbox.org/virtualbox/debian xenial contrib
/etc/apt/sources.list.d/danielrichter2007-ubuntu-grub-customizer-xenial.list:deb http://ppa.launchpad.net/danielrichter2007/grub-customizer/ubuntu xenial main
/etc/apt/sources.list.d/danielrichter2007-ubuntu-grub-customizer-xenial.list.distUpgrade:deb http://ppa.launchpad.net/danielrichter2007/grub-customizer/ubuntu xenial main
/etc/apt/sources.list.d/danielrichter2007-ubuntu-grub-customizer-xenial.list.save:deb http://ppa.launchpad.net/danielrichter2007/grub-customizer/ubuntu xenial main
/etc/apt/sources.list.d/ddebs.list:deb http://ddebs.ubuntu.com xenial main restricted universe multiverse
/etc/apt/sources.list.d/ddebs.list:deb http://ddebs.ubuntu.com xenial-updates main restricted universe multiverse
/etc/apt/sources.list.d/ddebs.list.distUpgrade:deb http://ddebs.ubuntu.com xenial main restricted universe multiverse
/etc/apt/sources.list.d/ddebs.list.distUpgrade:deb http://ddebs.ubuntu.com xenial-updates main restricted universe multiverse
/etc/apt/sources.list.d/ddebs.list.save:deb http://ddebs.ubuntu.com xenial main restricted universe multiverse
/etc/apt/sources.list.d/ddebs.list.save:deb http://ddebs.ubuntu.com xenial-updates main restricted universe multiverse
/etc/apt/sources.list.d/getdeb.list.save:deb http://archive.getdeb.net/ubuntu xenial-getdeb games
/etc/apt/sources.list.d/hsoft-ubuntu-ppa-xenial.list:deb http://ppa.launchpad.net/hsoft/ppa/ubuntu xenial main
/etc/apt/sources.list.d/hsoft-ubuntu-ppa-xenial.list.distUpgrade:deb http://ppa.launchpad.net/hsoft/ppa/ubuntu xenial main
/etc/apt/sources.list.d/hsoft-ubuntu-ppa-xenial.list.save:deb http://ppa.launchpad.net/hsoft/ppa/ubuntu xenial main
/etc/apt/sources.list.d/kubuntu-ppa-ubuntu-backports-xenial.list:deb http://ppa.launchpad.net/kubuntu-ppa/backports/ubuntu xenial main
/etc/apt/sources.list.d/kubuntu-ppa-ubuntu-backports-xenial.list.distUpgrade:deb http://ppa.launchpad.net/kubuntu-ppa/backports/ubuntu xenial main
/etc/apt/sources.list.d/kubuntu-ppa-ubuntu-backports-xenial.list.save:deb http://ppa.launchpad.net/kubuntu-ppa/backports/ubuntu xenial main
/etc/apt/sources.list.d/kxstudio-debian.gcc5.list:deb http://ppa.launchpad.net/kxstudio-debian/gcc5/ubuntu xenial main
/etc/apt/sources.list.d/kxstudio-debian.gcc5.list:deb http://ppa.launchpad.net/kxstudio-debian/gcc5-deps/ubuntu xenial main
/etc/apt/sources.list.d/kxstudio-debian.gcc5.list.distUpgrade:deb http://ppa.launchpad.net/kxstudio-debian/gcc5/ubuntu xenial main
/etc/apt/sources.list.d/kxstudio-debian.gcc5.list.distUpgrade:deb http://ppa.launchpad.net/kxstudio-debian/gcc5-deps/ubuntu xenial main
/etc/apt/sources.list.d/kxstudio-debian.gcc5.list.save:deb http://ppa.launchpad.net/kxstudio-debian/gcc5/ubuntu xenial main
/etc/apt/sources.list.d/kxstudio-debian.gcc5.list.save:deb http://ppa.launchpad.net/kxstudio-debian/gcc5-deps/ubuntu xenial main
/etc/apt/sources.list.d/kxstudio-debian.gcc5plus.list:deb http://ppa.launchpad.net/kxstudio-debian/kxstudio/ubuntu xenial main
/etc/apt/sources.list.d/kxstudio-debian.gcc5plus.list.distUpgrade:deb http://ppa.launchpad.net/kxstudio-debian/kxstudio/ubuntu xenial main
/etc/apt/sources.list.d/kxstudio-debian.gcc5plus.list.save:deb http://ppa.launchpad.net/kxstudio-debian/kxstudio/ubuntu xenial main
/etc/apt/sources.list.d/kxstudio-debian-ubuntu-ubuntus-xenial.list:deb http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu xenial main
/etc/apt/sources.list.d/kxstudio-debian-ubuntu-ubuntus-xenial.list.distUpgrade:deb http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu xenial main
/etc/apt/sources.list.d/kxstudio-debian-ubuntu-ubuntus-xenial.list.save:deb http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu xenial main
/etc/apt/sources.list.d/kxstudio-free.gcc5.list:deb [arch=amd64,i386] http://kxstudio.linuxaudio.org/repo/ gcc5 free
/etc/apt/sources.list.d/kxstudio-free.gcc5.list.distUpgrade:deb [arch=amd64,i386] http://kxstudio.linuxaudio.org/repo/ gcc5 free
/etc/apt/sources.list.d/kxstudio-free.gcc5.list.save:deb [arch=amd64,i386] http://kxstudio.linuxaudio.org/repo/ gcc5 free
/etc/apt/sources.list.d/kxstudio-free.list:deb [arch=amd64,i386] http://kxstudio.linuxaudio.org/repo/ stable free
/etc/apt/sources.list.d/kxstudio-free.list.distUpgrade:deb [arch=amd64,i386] http://kxstudio.linuxaudio.org/repo/ stable free
/etc/apt/sources.list.d/kxstudio-free.list.save:deb [arch=amd64,i386] http://kxstudio.linuxaudio.org/repo/ stable free
/etc/apt/sources.list.d/kxstudio-non-free.gcc5.list.save:deb [arch=amd64,i386] http://kxstudio.linuxaudio.org/repo/ gcc5 non-free
/etc/apt/sources.list.d/kxstudio-non-free.list.save:deb [arch=amd64,i386] http://kxstudio.linuxaudio.org/repo/ stable non-free
/etc/apt/sources.list.d/martin-salbaba-ubuntu-ppa_libimobiledevice-xenial.list:deb http://ppa.launchpad.net/martin-salbaba/ppa+libimobiledevice/ubuntu xenial main
/etc/apt/sources.list.d/martin-salbaba-ubuntu-ppa_libimobiledevice-xenial.list.distUpgrade:deb http://ppa.launchpad.net/martin-salbaba/ppa+libimobiledevice/ubuntu xenial main
/etc/apt/sources.list.d/martin-salbaba-ubuntu-ppa_libimobiledevice-xenial.list.save:deb http://ppa.launchpad.net/martin-salbaba/ppa+libimobiledevice/ubuntu xenial main
/etc/apt/sources.list.d/mjblenner-ubuntu-ppa-hal-xenial.list:deb http://ppa.launchpad.net/mjblenner/ppa-hal/ubuntu xenial main
/etc/apt/sources.list.d/mjblenner-ubuntu-ppa-hal-xenial.list.distUpgrade:deb http://ppa.launchpad.net/mjblenner/ppa-hal/ubuntu xenial main
/etc/apt/sources.list.d/mjblenner-ubuntu-ppa-hal-xenial.list.save:deb http://ppa.launchpad.net/mjblenner/ppa-hal/ubuntu xenial main
/etc/apt/sources.list.d/mono-official-stable.list:deb https://download.mono-project.com/repo/ubuntu stable-xenial main
/etc/apt/sources.list.d/mono-official-stable.list.distUpgrade:deb https://download.mono-project.com/repo/ubuntu stable-xenial main
/etc/apt/sources.list.d/mono-official-stable.list.save:deb https://download.mono-project.com/repo/ubuntu stable-xenial main
/etc/apt/sources.list.d/mozillateam-ubuntu-firefox-next-xenial.list:deb http://ppa.launchpad.net/mozillateam/firefox-next/ubuntu xenial main
/etc/apt/sources.list.d/mscore-ubuntu-ubuntu-mscore-stable-xenial.list:deb http://ppa.launchpad.net/mscore-ubuntu/mscore-stable/ubuntu xenial main
/etc/apt/sources.list.d/mscore-ubuntu-ubuntu-mscore-stable-xenial.list.distUpgrade:deb http://ppa.launchpad.net/mscore-ubuntu/mscore-stable/ubuntu xenial main
/etc/apt/sources.list.d/mscore-ubuntu-ubuntu-mscore-stable-xenial.list.save:deb http://ppa.launchpad.net/mscore-ubuntu/mscore-stable/ubuntu xenial main
/etc/apt/sources.list.d/nilarimogard-ubuntu-webupd8-xenial.list:deb http://ppa.launchpad.net/nilarimogard/webupd8/ubuntu xenial main
/etc/apt/sources.list.d/nilarimogard-ubuntu-webupd8-xenial.list.distUpgrade:deb http://ppa.launchpad.net/nilarimogard/webupd8/ubuntu xenial main
/etc/apt/sources.list.d/nilarimogard-ubuntu-webupd8-xenial.list.save:deb http://ppa.launchpad.net/nilarimogard/webupd8/ubuntu xenial main
/etc/apt/sources.list.d/qtcam-ubuntu-xenial-xenial.list:deb http://ppa.launchpad.net/qtcam/xenial/ubuntu xenial main
/etc/apt/sources.list.d/qtcam-ubuntu-xenial-xenial.list.distUpgrade:deb http://ppa.launchpad.net/qtcam/xenial/ubuntu xenial main
/etc/apt/sources.list.d/qtcam-ubuntu-xenial-xenial.list.save:deb http://ppa.launchpad.net/qtcam/xenial/ubuntu xenial main
/etc/apt/sources.list.d/saiarcot895-ubuntu-flightgear-xenial.list:deb http://ppa.launchpad.net/saiarcot895/flightgear/ubuntu xenial main
/etc/apt/sources.list.d/saiarcot895-ubuntu-flightgear-xenial.list.distUpgrade:deb http://ppa.launchpad.net/saiarcot895/flightgear/ubuntu xenial main
/etc/apt/sources.list.d/saiarcot895-ubuntu-flightgear-xenial.list.save:deb http://ppa.launchpad.net/saiarcot895/flightgear/ubuntu xenial main
/etc/apt/sources.list.d/teamviewer.list:deb http://linux.teamviewer.com/deb stable main
/etc/apt/sources.list.d/teamviewer.list.distUpgrade:deb http://linux.teamviewer.com/deb stable main
/etc/apt/sources.list.d/teamviewer.list.dpkg-old:deb http://linux.teamviewer.com/deb stable main
/etc/apt/sources.list.d/teamviewer.list.save:deb http://linux.teamviewer.com/deb stable main
/etc/apt/sources.list.d/thopiekar-ubuntu-miraclecast-xenial.list:deb http://ppa.launchpad.net/thopiekar/miraclecast/ubuntu xenial main
/etc/apt/sources.list.d/thopiekar-ubuntu-miraclecast-xenial.list.distUpgrade:deb http://ppa.launchpad.net/thopiekar/miraclecast/ubuntu xenial main
/etc/apt/sources.list.d/thopiekar-ubuntu-miraclecast-xenial.list.save:deb http://ppa.launchpad.net/thopiekar/miraclecast/ubuntu xenial main
/etc/apt/sources.list.d/tor.list:deb https://deb.torproject.org/torproject.org xenial main
/etc/apt/sources.list.d/tor.list:deb-src https://deb.torproject.org/torproject.org xenial main
/etc/apt/sources.list.d/tor.list.distUpgrade:deb https://deb.torproject.org/torproject.org xenial main
/etc/apt/sources.list.d/tor.list.distUpgrade:deb-src https://deb.torproject.org/torproject.org xenial main
/etc/apt/sources.list.d/tor.list.save:deb https://deb.torproject.org/torproject.org xenial main
/etc/apt/sources.list.d/tor.list.save:deb-src https://deb.torproject.org/torproject.org xenial main
/etc/apt/sources.list.d/ubuntu-desktop-ubuntu-ubuntu-make-xenial.list:deb http://ppa.launchpad.net/ubuntu-desktop/ubuntu-make/ubuntu xenial main
/etc/apt/sources.list.d/ubuntu-desktop-ubuntu-ubuntu-make-xenial.list.distUpgrade:deb http://ppa.launchpad.net/ubuntu-desktop/ubuntu-make/ubuntu xenial main
/etc/apt/sources.list.d/ubuntu-desktop-ubuntu-ubuntu-make-xenial.list.save:deb http://ppa.launchpad.net/ubuntu-desktop/ubuntu-make/ubuntu xenial main
/etc/apt/sources.list.d/ubuntu-mozilla-security-ubuntu-ppa-xenial.list:deb http://ppa.launchpad.net/ubuntu-mozilla-security/ppa/ubuntu xenial main
/etc/apt/sources.list.d/ubuntu-mozilla-security-ubuntu-ppa-xenial.list.distUpgrade:deb http://ppa.launchpad.net/ubuntu-mozilla-security/ppa/ubuntu xenial main
/etc/apt/sources.list.d/ubuntu-mozilla-security-ubuntu-ppa-xenial.list.save:deb http://ppa.launchpad.net/ubuntu-mozilla-security/ppa/ubuntu xenial main
/etc/apt/sources.list.d/ubuntu-toolchain-r-ubuntu-test-xenial.list:deb http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial main
/etc/apt/sources.list.d/ubuntu-toolchain-r-ubuntu-test-xenial.list.distUpgrade:deb http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial main
/etc/apt/sources.list.d/ubuntu-toolchain-r-ubuntu-test-xenial.list.save:deb http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial main
/etc/apt/sources.list.d/virtualbox.list.save:deb http://download.virtualbox.org/virtualbox/debian xenial contrib
/etc/apt/sources.list.d/webupd8team-ubuntu-tor-browser-xenial.list:deb http://ppa.launchpad.net/webupd8team/tor-browser/ubuntu xenial main
/etc/apt/sources.list.d/webupd8team-ubuntu-tor-browser-xenial.list.distUpgrade:deb http://ppa.launchpad.net/webupd8team/tor-browser/ubuntu xenial main
/etc/apt/sources.list.d/webupd8team-ubuntu-tor-browser-xenial.list.save:deb http://ppa.launchpad.net/webupd8team/tor-browser/ubuntu xenial main
/etc/apt/sources.list.d/webupd8team-ubuntu-y-ppa-manager-xenial.list:deb http://ppa.launchpad.net/webupd8team/y-ppa-manager/ubuntu xenial main
/etc/apt/sources.list.d/webupd8team-ubuntu-y-ppa-manager-xenial.list.distUpgrade:deb http://ppa.launchpad.net/webupd8team/y-ppa-manager/ubuntu xenial main
/etc/apt/sources.list.d/webupd8team-ubuntu-y-ppa-manager-xenial.list.save:deb http://ppa.launchpad.net/webupd8team/y-ppa-manager/ubuntu xenial main
/etc/apt/sources.list.d/yannubuntu-ubuntu-boot-repair-xenial.list:deb http://ppa.launchpad.net/yannubuntu/boot-repair/ubuntu xenial main
/etc/apt/sources.list.d/yannubuntu-ubuntu-boot-repair-xenial.list.distUpgrade:deb http://ppa.launchpad.net/yannubuntu/boot-repair/ubuntu xenial main
/etc/apt/sources.list.d/yannubuntu-ubuntu-boot-repair-xenial.list.save:deb http://ppa.launchpad.net/yannubuntu/boot-repair/ubuntu xenial main

Sorry about the big print. Unexpected.

You need to log in before you can comment on or make changes to this bug.