Contents:
...
View the “md127” RAID status.
| Code Block |
|---|
cate@jupiterrdlab@exxact:~$ cat /proc/mdstat Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10] md127 : inactive sdc1[2](S) sde1[4](S) sdf1[6](S) sdd1[3](S) sdb1[1](S) sda1[0](S) 117190146048 blocks super 1.2 unused devices: <none> |
...
View additional details of “md127”.
| Code Block |
|---|
root@jupiterrdlab@exxact:/home/exx# mdadm --query /dev/md127 /dev/md127: (null) 0 devices, 6 spares. Use mdadm --detail for more detail. root@jupiter:/home/exx# mdadm --detail /dev/md127 /dev/md127: Version : 1.2 Raid Level : raid0 Total Devices : 6 Persistence : Superblock is persistent State : inactive Working Devices : 6 Name : jupiter:0 (local to host jupiter) UUID : 03f505ac:d5a96bac:5d4da761:810ad4a6 Events : 93758 Number Major Minor RaidDevice - 8 1 - /dev/sda1 - 8 81 - /dev/sdf1 - 8 65 - /dev/sde1 - 8 49 - /dev/sdd1 - 8 33 - /dev/sdc1 - 8 17 - /dev/sdb1 |
...
Additional information on the UUID can be checked to verify proper OS identification.
| Code Block |
|---|
root@jupiterrdlab@exxact:/home/exx# mdadm --detail --scan /dev/md127 INACTIVE-ARRAY /dev/md127 metadata=1.2 name=jupiter:0 UUID=03f505ac:d5a96bac:5d4da761:810ad4a6 root@jupiter:/home# cat /etc/mdadm/mdadm.conf # ARRAY /dev/md0 metadata=1.2 spares=1 name=ubuntu-server:0 UUID=b690237f:da587456:50a2b64e:52c2abc6 MAILADDR root ARRAY /dev/md/data metadata=1.2 UUID=8e1d9efa:a6028ec7:39cd0e4f:c76c036f name=sn4622111485:data |
...
Display additional RAID details to identify RAID failure.
| Code Block |
|---|
root@jupiterrdlab@exxact:/home# mdadm --stop /dev/md127 mdadm: stopped /dev/md127 root@jupiter:/home# mdadm --assemble --scan -v-verbose mdadm: looking for devices for /dev/md/data mdadm: /dev/sde1 has wrong uuid. mdadm: No super block found on /dev/sde (Expected magic a92b4efc, got 00000000) mdadm: no RAID superblock on /dev/sde mdadm: /dev/sdf1 has wrong uuid. mdadm: No super block found on /dev/sdf (Expected magic a92b4efc, got 00000000) mdadm: no RAID superblock on /dev/sdf mdadm: /dev/sdc1 has wrong uuid. mdadm: No super block found on /dev/sdc (Expected magic a92b4efc, got 00000000) mdadm: no RAID superblock on /dev/sdc mdadm: /dev/sdb1 has wrong uuid. mdadm: No super block found on /dev/sdb (Expected magic a92b4efc, got 00000000) mdadm: no RAID superblock on /dev/sdb mdadm: /dev/sdd1 has wrong uuid. mdadm: No super block found on /dev/sdd (Expected magic a92b4efc, got 00000000) mdadm: no RAID superblock on /dev/sdd mdadm: /dev/sda1 has wrong uuid. mdadm: No super block found on /dev/sda (Expected magic a92b4efc, got 00000000) mdadm: no RAID superblock on /dev/sda mdadm: No super block found on /dev/nvme0n1p4 (Expected magic a92b4efc, got 00000477) mdadm: no RAID superblock on /dev/nvme0n1p4 mdadm: No super block found on /dev/nvme0n1p3 (Expected magic a92b4efc, got 0000003f) mdadm: no RAID superblock on /dev/nvme0n1p3 mdadm: No super block found on /dev/nvme0n1p2 (Expected magic a92b4efc, got 00000081) mdadm: no RAID superblock on /dev/nvme0n1p2 mdadm: No super block found on /dev/nvme0n1p1 (Expected magic a92b4efc, got 00000000) mdadm: no RAID superblock on /dev/nvme0n1p1 mdadm: No super block found on /dev/nvme0n1 (Expected magic a92b4efc, got 00000000) mdadm: no RAID superblock on /dev/nvme0n1 mdadm: No super block found on /dev/nvme1n1p1 (Expected magic a92b4efc, got 000005c1) mdadm: no RAID superblock on /dev/nvme1n1p1 mdadm: No super block found on /dev/nvme1n1 (Expected magic a92b4efc, got 00000000) mdadm: no RAID superblock on /dev/nvme1n1 mdadm: No super block found on /dev/loop5 (Expected magic a92b4efc, got a6eff301) mdadm: no RAID superblock on /dev/loop5 mdadm: No super block found on /dev/loop4 (Expected magic a92b4efc, got a6eff301) mdadm: no RAID superblock on /dev/loop4 mdadm: No super block found on /dev/loop3 (Expected magic a92b4efc, got fa2c5214) mdadm: no RAID superblock on /dev/loop3 mdadm: No super block found on /dev/loop2 (Expected magic a92b4efc, got 9dbc89cd) mdadm: no RAID superblock on /dev/loop2 mdadm: No super block found on /dev/loop1 (Expected magic a92b4efc, got 0000000a) mdadm: no RAID superblock on /dev/loop1 mdadm: No super block found on /dev/loop0 (Expected magic a92b4efc, got 32138a62) mdadm: no RAID superblock on /dev/loop0 |
Wrong UUID on the six RAID drives: sda, sdb, sdc, sdd, sde, sdf.
Conclusion
Examine each drive through MDADM. It looks like each drive still shows the RAID level as RAID5.
| Code Block |
|---|
rdlab@exxact:/home# mdadm --examine /dev/sd[abcdef]1
/dev/sda1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 03f505ac:d5a96bac:5d4da761:810ad4a6
Name : jupiter:0 (local to host jupiter)
Creation Time : Tue Aug 15 12:04:05 2023
Raid Level : raid5
Raid Devices : 6
Avail Dev Size : 39063382016 (18626.87 GiB 20000.45 GB)
Array Size : 97658455040 (93134.36 GiB 100002.26 GB)
Data Offset : 264192 sectors
Super Offset : 8 sectors
Unused Space : before=264088 sectors, after=0 sectors
State : active
Device UUID : 1ce2160d:9a4d9d85:acfb481a:360faccc
Internal Bitmap : 8 sectors from superblock
Update Time : Sun Sep 24 15:52:42 2023
Bad Block Log : 512 entries available at offset 88 sectors
Checksum : 22583091 - correct
Events : 93758
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 0
Array State : AAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdb1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 03f505ac:d5a96bac:5d4da761:810ad4a6
Name : jupiter:0 (local to host jupiter)
Creation Time : Tue Aug 15 12:04:05 2023
Raid Level : raid5
Raid Devices : 6
Avail Dev Size : 39063382016 (18626.87 GiB 20000.45 GB)
Array Size : 97658455040 (93134.36 GiB 100002.26 GB)
Data Offset : 264192 sectors
Super Offset : 8 sectors
Unused Space : before=264088 sectors, after=0 sectors
State : active
Device UUID : 936b1233:4370fef4:a5b00add:ad78d8bf
Internal Bitmap : 8 sectors from superblock
Update Time : Sun Sep 24 15:52:42 2023
Bad Block Log : 512 entries available at offset 88 sectors
Checksum : 6da2fb23 - correct
Events : 93758
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 1
Array State : AAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdc1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 03f505ac:d5a96bac:5d4da761:810ad4a6
Name : jupiter:0 (local to host jupiter)
Creation Time : Tue Aug 15 12:04:05 2023
Raid Level : raid5
Raid Devices : 6
Avail Dev Size : 39063382016 (18626.87 GiB 20000.45 GB)
Array Size : 97658455040 (93134.36 GiB 100002.26 GB)
Data Offset : 264192 sectors
Super Offset : 8 sectors
Unused Space : before=264088 sectors, after=0 sectors
State : clean
Device UUID : cadf27f8:3814e183:fd4c0a6e:01a1908b
Internal Bitmap : 8 sectors from superblock
Update Time : Sun Sep 24 15:54:46 2023
Bad Block Log : 512 entries available at offset 88 sectors
Checksum : 1e50d87a - correct
Events : 93761
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 2
Array State : ..AAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdd1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 03f505ac:d5a96bac:5d4da761:810ad4a6
Name : jupiter:0 (local to host jupiter)
Creation Time : Tue Aug 15 12:04:05 2023
Raid Level : raid5
Raid Devices : 6
Avail Dev Size : 39063382016 (18626.87 GiB 20000.45 GB)
Array Size : 97658455040 (93134.36 GiB 100002.26 GB)
Data Offset : 264192 sectors
Super Offset : 8 sectors
Unused Space : before=264088 sectors, after=0 sectors
State : clean
Device UUID : 043ea22c:0b072966:70a48109:b02cfdb2
Internal Bitmap : 8 sectors from superblock
Update Time : Sun Sep 24 15:54:46 2023
Bad Block Log : 512 entries available at offset 88 sectors
Checksum : f7f70ca8 - correct
Events : 93761
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 3
Array State : ..AAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sde1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 03f505ac:d5a96bac:5d4da761:810ad4a6
Name : jupiter:0 (local to host jupiter)
Creation Time : Tue Aug 15 12:04:05 2023
Raid Level : raid5
Raid Devices : 6
Avail Dev Size : 39063382016 (18626.87 GiB 20000.45 GB)
Array Size : 97658455040 (93134.36 GiB 100002.26 GB)
Data Offset : 264192 sectors
Super Offset : 8 sectors
Unused Space : before=264088 sectors, after=0 sectors
State : clean
Device UUID : 22b3d070:6d3a7111:ceeb75e4:4f70cc8d
Internal Bitmap : 8 sectors from superblock
Update Time : Sun Sep 24 15:54:46 2023
Bad Block Log : 512 entries available at offset 88 sectors
Checksum : 9d314027 - correct
Events : 93761
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 4
Array State : ..AAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdf1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 03f505ac:d5a96bac:5d4da761:810ad4a6
Name : jupiter:0 (local to host jupiter)
Creation Time : Tue Aug 15 12:04:05 2023
Raid Level : raid5
Raid Devices : 6
Avail Dev Size : 39063382016 (18626.87 GiB 20000.45 GB)
Array Size : 97658455040 (93134.36 GiB 100002.26 GB)
Data Offset : 264192 sectors
Super Offset : 8 sectors
Unused Space : before=264088 sectors, after=0 sectors
State : clean
Device UUID : 304c168f:5f981d99:1777b5dc:67771ac8
Internal Bitmap : 8 sectors from superblock
Update Time : Sun Sep 24 15:54:46 2023
Bad Block Log : 512 entries available at offset 88 sectors
Checksum : 75b0c98b - correct
Events : 93761
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 5
Array State : ..AAAA ('A' == active, '.' == missing, 'R' == replacing) |
Displaying UUID values for comparision.
| Code Block |
|---|
rdlab@exxact:/home# blkid
/dev/nvme1n1p1: UUID="7ca82a8b-e49f-4af2-9e45-ca84ffcf8d52" TYPE="ext4" PARTUUID="1b1fd338-33d6-4409-8f73-c28fe5b64c9d"
/dev/nvme0n1p1: UUID="C232-F548" TYPE="vfat" PARTUUID="bb710908-76b9-4722-bcbc-3326cc0eb476"
/dev/nvme0n1p2: UUID="6070f6d4-8edf-4032-b0d3-e9709be0326e" TYPE="ext4" PARTUUID="8801aa80-aef8-460b-86fd-46e3eeefa2df"
/dev/nvme0n1p3: UUID="7639e5c3-3fcb-4b5b-953e-58461c5b9fb9" TYPE="swap" PARTUUID="0791fca0-00fa-47e6-ab49-fab51c3c4137"
/dev/nvme0n1p4: UUID="7f5dfbfd-e027-4073-81a6-758484ecc019" TYPE="ext4" PARTUUID="eaa3624b-6ab6-4005-b645-8bf4dccdf6ba"
/dev/sda1: UUID="03f505ac-d5a9-6bac-5d4d-a761810ad4a6" UUID_SUB="1ce2160d-9a4d-9d85-acfb-481a360faccc" LABEL="jupiter:0" TYPE="linux_raid_member" PARTUUID="4058a593-2465-4406-bd4b-ea7e5600be4f"
/dev/sdd1: UUID="03f505ac-d5a9-6bac-5d4d-a761810ad4a6" UUID_SUB="043ea22c-0b07-2966-70a4-8109b02cfdb2" LABEL="jupiter:0" TYPE="linux_raid_member" PARTUUID="948c488a-ce92-4bbb-8fb5-590cf8f37703"
/dev/sdb1: UUID="03f505ac-d5a9-6bac-5d4d-a761810ad4a6" UUID_SUB="936b1233-4370-fef4-a5b0-0addad78d8bf" LABEL="jupiter:0" TYPE="linux_raid_member" PARTUUID="af27a600-c4e0-4de7-bd8c-322f32bb056c"
/dev/sdc1: UUID="03f505ac-d5a9-6bac-5d4d-a761810ad4a6" UUID_SUB="cadf27f8-3814-e183-fd4c-0a6e01a1908b" LABEL="jupiter:0" TYPE="linux_raid_member" PARTUUID="e45e7f5f-577f-46bf-92f2-f72103f0da5a"
/dev/sdf1: UUID="03f505ac-d5a9-6bac-5d4d-a761810ad4a6" UUID_SUB="304c168f-5f98-1d99-1777-b5dc67771ac8" LABEL="jupiter:0" TYPE="linux_raid_member" PARTUUID="69ae0247-dc71-47fa-bcef-855bf7672fdb"
/dev/sde1: UUID="03f505ac-d5a9-6bac-5d4d-a761810ad4a6" UUID_SUB="22b3d070-6d3a-7111-ceeb-75e44f70cc8d" LABEL="jupiter:0" TYPE="linux_raid_member" PARTUUID="5eaebad0-b8a8-4ae1-a6a9-4ffa7988e95b"
/dev/loop0: TYPE="squashfs"
/dev/loop1: TYPE="squashfs"
/dev/loop2: TYPE="squashfs"
/dev/loop3: TYPE="squashfs"
/dev/loop4: TYPE="squashfs"
/dev/loop5: TYPE="squashfs" |
Conclusion
The drives are still identified as RAID5, but the configuration is RAID0. At this point of the investigation, it was decided to wipe out the existing /dev/md127 (RAID0) with associated devices and re-create the RAID5 configuration.
REF: ZD-4301 / ZD-6131 / ZD-6713 / ZD-7113