Closed Bug 605170 Opened 15 years ago Closed 15 years ago

linux-ix-slave23 has r/o filesystem

Categories

(Release Engineering :: General, defect)

Product:
Release Engineering
Component:
General
Platform:
x86_64
Linux
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: catlee, Assigned: catlee)

Details

(Whiteboard: [badslave?])

Slave has been disconnected. From dmesg: sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 31553056 Buffer I/O error on device sda4, logical block 8207 lost page write due to I/O error on sda4 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 189069112 Buffer I/O error on device sda4, logical block 19697714 lost page write due to I/O error on sda4 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 191395240 Buffer I/O error on device sda4, logical block 19988480 lost page write due to I/O error on sda4 Buffer I/O error on device sda4, logical block 19988481 lost page write due to I/O error on sda4 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 389810616 Buffer I/O error on device sda4, logical block 44790402 lost page write due to I/O error on sda4 Buffer I/O error on device sda4, logical block 44790403 lost page write due to I/O error on sda4 Buffer I/O error on device sda4, logical block 44790404 lost page write due to I/O error on sda4 Buffer I/O error on device sda4, logical block 44790405 lost page write due to I/O error on sda4 Buffer I/O error on device sda4, logical block 44790406 lost page write due to I/O error on sda4 Buffer I/O error on device sda4, logical block 44790407 lost page write due to I/O error on sda4 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 191396424 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 197424552 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 197424904 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 197679168 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 253998504 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 253998608 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 254015000 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 254015104 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 281048544 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 293062088 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 293062192 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 295990696 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 240563880 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 241759816 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 241759920 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 245725256 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 252474840 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 253818392 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 253818496 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 266368424 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 210007464 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 210007512 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 212891048 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 212891112 sd 0:0:0:0: SCSI error: return code = 0x06000000 end_request: I/O error, dev sda, sector 213415336 Aborting journal on device sda4. ext3_abort called. EXT3-fs error (device sda4): ext3_journal_start_sb: Detected aborted journal Remounting filesystem read-only __journal_remove_journal_head: freeing b_committed_data
[root@linux-ix-slave23 ~]# fsck -C -p /dev/sda4 fsck 1.39 (29-May-2006) /dev/sda4: recovering journal /dev/sda4 has been mounted 38 times without being checked, check forced. Symlink /slave/mozilla-1.9.2-linux/build/obj-firefox/_tests/testing/mochitest/chrome/modules/plugin/test/test_bug479979.xul (inode #19763854) is invalid. /dev/sda4: UNEXPECTED INCONSISTENCY; RUN fsck MANUALLY. (i.e., without -a or -p options)
Assignee: nobody → catlee
Lots of problems in /slave/mozilla-1.9.2-linux, and /slave/mozilla-central-linux-l10n-nightly; deleted them.
Initiated drive test with: smartctl -d ata -t short /dev/sda results of smartctl -d ata --all /dev/sda: smartctl version 5.36 [i686-redhat-linux-gnu] Copyright (C) 2002-6 Bruce Allen Home page is http://smartmontools.sourceforge.net/ === START OF INFORMATION SECTION === Device Model: ST3250318AS Serial Number: 6VY746HZ Firmware Version: CC38 User Capacity: 250,059,350,016 bytes Device is: Not in smartctl database [for details use: -P showall] ATA Version is: 8 ATA Standard is: Not recognized. Minor revision code: 0x29 Local Time is: Mon Oct 18 11:22:33 2010 PDT SMART support is: Available - device has SMART capability. SMART support is: Enabled === START OF READ SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED General SMART Values: Offline data collection status: (0x82) Offline data collection activity was completed without error. Auto Offline Data Collection: Enabled. Self-test execution status: ( 0) The previous self-test routine completed without error or no self-test has ever been run. Total time to complete Offline data collection: ( 600) seconds. Offline data collection capabilities: (0x7b) SMART execute Offline immediate. Auto Offline data collection on/off support. Suspend Offline collection upon new command. Offline surface scan supported. Self-test supported. Conveyance Self-test supported. Selective Self-test supported. SMART capabilities: (0x0003) Saves SMART data before entering power-saving mode. Supports SMART auto save timer. Error logging capability: (0x01) Error logging supported. General Purpose Logging supported. Short self-test routine recommended polling time: ( 1) minutes. Extended self-test routine recommended polling time: ( 46) minutes. Conveyance self-test routine recommended polling time: ( 2) minutes. SMART Attributes Data Structure revision number: 10 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x000f 112 100 006 Pre-fail Always - 46224221 3 Spin_Up_Time 0x0003 098 098 000 Pre-fail Always - 0 4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 16 5 Reallocated_Sector_Ct 0x0033 100 100 036 Pre-fail Always - 0 7 Seek_Error_Rate 0x000f 067 060 030 Pre-fail Always - 5948837 9 Power_On_Hours 0x0032 100 100 000 Old_age Always - 685 10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0 12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 8 183 Unknown_Attribute 0x0032 100 100 000 Old_age Always - 0 184 Unknown_Attribute 0x0032 100 100 099 Old_age Always - 0 187 Unknown_Attribute 0x0032 100 100 000 Old_age Always - 0 188 Unknown_Attribute 0x0032 100 098 000 Old_age Always - 131148 189 Unknown_Attribute 0x003a 100 100 000 Old_age Always - 0 190 Unknown_Attribute 0x0022 079 073 045 Old_age Always - 370409493 194 Temperature_Celsius 0x0022 021 040 000 Old_age Always - 21 (Lifetime Min/Max 0/19) 195 Hardware_ECC_Recovered 0x001a 039 021 000 Old_age Always - 46224221 197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0 198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0 199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 0 240 Head_Flying_Hours 0x0000 100 253 000 Old_age Offline - 8126078124737 241 Unknown_Attribute 0x0000 100 253 000 Old_age Offline - 1280800416 242 Unknown_Attribute 0x0000 100 253 000 Old_age Offline - 2399126571 SMART Error Log Version: 1 No Errors Logged SMART Self-test log structure revision number 1 Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error # 1 Short offline Completed without error 00% 685 - SMART Selective self-test log data structure revision number 1 SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS 1 0 0 Not_testing 2 0 0 Not_testing 3 0 0 Not_testing 4 0 0 Not_testing 5 0 0 Not_testing Selective self-test flags (0x0): After scanning selected spans, do NOT read-scan remainder of disk. If Selective self-test is pending on power-up, resume after 0 minute delay.
test results look ok, rebooted, connected back to master.
Status: NEW → RESOLVED
Closed: 15 years ago
Resolution: --- → FIXED
Product: mozilla.org → Release Engineering
You need to log in before you can comment on or make changes to this bug.