Versions Compared

Version Old Version 4 New Version Current
Changes made by

¥ (Unlicensed)

¥ (Unlicensed)

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Contents:

...

View the “md127” RAID status.

Code Block
cate@jupiterrdlab@exxact:~$ cat /proc/mdstat
Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10]
md127 : inactive sdc1[2](S) sde1[4](S) sdf1[6](S) sdd1[3](S) sdb1[1](S) sda1[0](S)
      117190146048 blocks super 1.2

unused devices: <none>

...

View additional details of “md127”.

Code Block
root@jupiterrdlab@exxact:/home/exx# mdadm --query /dev/md127
/dev/md127:  (null) 0 devices, 6 spares. Use mdadm --detail for more detail.

root@jupiter:/home/exx# mdadm --detail /dev/md127
/dev/md127:
           Version : 1.2
        Raid Level : raid0
     Total Devices : 6
       Persistence : Superblock is persistent

             State : inactive
   Working Devices : 6

              Name : jupiter:0  (local to host jupiter)
              UUID : 03f505ac:d5a96bac:5d4da761:810ad4a6
            Events : 93758

    Number   Major   Minor   RaidDevice

       -       8        1        -        /dev/sda1
       -       8       81        -        /dev/sdf1
       -       8       65        -        /dev/sde1
       -       8       49        -        /dev/sdd1
       -       8       33        -        /dev/sdc1
       -       8       17        -        /dev/sdb1

...

Additional information on the UUID can be checked to verify proper OS identification.

Code Block
root@jupiterrdlab@exxact:/home/exx# mdadm --detail --scan /dev/md127
INACTIVE-ARRAY /dev/md127 metadata=1.2 name=jupiter:0 UUID=03f505ac:d5a96bac:5d4da761:810ad4a6

root@jupiter:/home# cat /etc/mdadm/mdadm.conf
# ARRAY /dev/md0 metadata=1.2 spares=1 name=ubuntu-server:0 UUID=b690237f:da587456:50a2b64e:52c2abc6
MAILADDR root
ARRAY /dev/md/data  metadata=1.2 UUID=8e1d9efa:a6028ec7:39cd0e4f:c76c036f name=sn4622111485:data

...

Display additional RAID details to identify RAID failure.

Code Block
root@jupiterrdlab@exxact:/home# mdadm --stop /dev/md127
mdadm: stopped /dev/md127

root@jupiter:/home# mdadm --assemble --scan --verbose
mdadm: looking for devices for /dev/md/data
mdadm: /dev/sde1 has wrong uuid.
mdadm: No super block found on /dev/sde (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/sde
mdadm: /dev/sdf1 has wrong uuid.
mdadm: No super block found on /dev/sdf (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/sdf
mdadm: /dev/sdc1 has wrong uuid.
mdadm: No super block found on /dev/sdc (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/sdc
mdadm: /dev/sdb1 has wrong uuid.
mdadm: No super block found on /dev/sdb (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/sdb
mdadm: /dev/sdd1 has wrong uuid.
mdadm: No super block found on /dev/sdd (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/sdd
mdadm: /dev/sda1 has wrong uuid.
mdadm: No super block found on /dev/sda (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/sda
mdadm: No super block found on /dev/nvme0n1p4 (Expected magic a92b4efc, got 00000477)
mdadm: no RAID superblock on /dev/nvme0n1p4
mdadm: No super block found on /dev/nvme0n1p3 (Expected magic a92b4efc, got 0000003f)
mdadm: no RAID superblock on /dev/nvme0n1p3
mdadm: No super block found on /dev/nvme0n1p2 (Expected magic a92b4efc, got 00000081)
mdadm: no RAID superblock on /dev/nvme0n1p2
mdadm: No super block found on /dev/nvme0n1p1 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/nvme0n1p1
mdadm: No super block found on /dev/nvme0n1 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/nvme0n1
mdadm: No super block found on /dev/nvme1n1p1 (Expected magic a92b4efc, got 000005c1)
mdadm: no RAID superblock on /dev/nvme1n1p1
mdadm: No super block found on /dev/nvme1n1 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/nvme1n1
mdadm: No super block found on /dev/loop5 (Expected magic a92b4efc, got a6eff301)
mdadm: no RAID superblock on /dev/loop5
mdadm: No super block found on /dev/loop4 (Expected magic a92b4efc, got a6eff301)
mdadm: no RAID superblock on /dev/loop4
mdadm: No super block found on /dev/loop3 (Expected magic a92b4efc, got fa2c5214)
mdadm: no RAID superblock on /dev/loop3
mdadm: No super block found on /dev/loop2 (Expected magic a92b4efc, got 9dbc89cd)
mdadm: no RAID superblock on /dev/loop2
mdadm: No super block found on /dev/loop1 (Expected magic a92b4efc, got 0000000a)
mdadm: no RAID superblock on /dev/loop1
mdadm: No super block found on /dev/loop0 (Expected magic a92b4efc, got 32138a62)
mdadm: no RAID superblock on /dev/loop0

...

Examine each drive through MDADM. It looks like each drive still shows the RAID level as RAID5.

Code Block
root@jupiterrdlab@exxact:/home# mdadm --examine /dev/sd[abcdef]1
/dev/sda1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 03f505ac:d5a96bac:5d4da761:810ad4a6
           Name : jupiter:0  (local to host jupiter)
  Creation Time : Tue Aug 15 12:04:05 2023
     Raid Level : raid5
   Raid Devices : 6

 Avail Dev Size : 39063382016 (18626.87 GiB 20000.45 GB)
     Array Size : 97658455040 (93134.36 GiB 100002.26 GB)
    Data Offset : 264192 sectors
   Super Offset : 8 sectors
   Unused Space : before=264088 sectors, after=0 sectors
          State : active
    Device UUID : 1ce2160d:9a4d9d85:acfb481a:360faccc

Internal Bitmap : 8 sectors from superblock
    Update Time : Sun Sep 24 15:52:42 2023
  Bad Block Log : 512 entries available at offset 88 sectors
       Checksum : 22583091 - correct
         Events : 93758

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 0
   Array State : AAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdb1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 03f505ac:d5a96bac:5d4da761:810ad4a6
           Name : jupiter:0  (local to host jupiter)
  Creation Time : Tue Aug 15 12:04:05 2023
     Raid Level : raid5
   Raid Devices : 6

 Avail Dev Size : 39063382016 (18626.87 GiB 20000.45 GB)
     Array Size : 97658455040 (93134.36 GiB 100002.26 GB)
    Data Offset : 264192 sectors
   Super Offset : 8 sectors
   Unused Space : before=264088 sectors, after=0 sectors
          State : active
    Device UUID : 936b1233:4370fef4:a5b00add:ad78d8bf

Internal Bitmap : 8 sectors from superblock
    Update Time : Sun Sep 24 15:52:42 2023
  Bad Block Log : 512 entries available at offset 88 sectors
       Checksum : 6da2fb23 - correct
         Events : 93758

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 1
   Array State : AAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdc1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 03f505ac:d5a96bac:5d4da761:810ad4a6
           Name : jupiter:0  (local to host jupiter)
  Creation Time : Tue Aug 15 12:04:05 2023
     Raid Level : raid5
   Raid Devices : 6

 Avail Dev Size : 39063382016 (18626.87 GiB 20000.45 GB)
     Array Size : 97658455040 (93134.36 GiB 100002.26 GB)
    Data Offset : 264192 sectors
   Super Offset : 8 sectors
   Unused Space : before=264088 sectors, after=0 sectors
          State : clean
    Device UUID : cadf27f8:3814e183:fd4c0a6e:01a1908b

Internal Bitmap : 8 sectors from superblock
    Update Time : Sun Sep 24 15:54:46 2023
  Bad Block Log : 512 entries available at offset 88 sectors
       Checksum : 1e50d87a - correct
         Events : 93761

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 2
   Array State : ..AAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdd1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 03f505ac:d5a96bac:5d4da761:810ad4a6
           Name : jupiter:0  (local to host jupiter)
  Creation Time : Tue Aug 15 12:04:05 2023
     Raid Level : raid5
   Raid Devices : 6

 Avail Dev Size : 39063382016 (18626.87 GiB 20000.45 GB)
     Array Size : 97658455040 (93134.36 GiB 100002.26 GB)
    Data Offset : 264192 sectors
   Super Offset : 8 sectors
   Unused Space : before=264088 sectors, after=0 sectors
          State : clean
    Device UUID : 043ea22c:0b072966:70a48109:b02cfdb2

Internal Bitmap : 8 sectors from superblock
    Update Time : Sun Sep 24 15:54:46 2023
  Bad Block Log : 512 entries available at offset 88 sectors
       Checksum : f7f70ca8 - correct
         Events : 93761

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 3
   Array State : ..AAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sde1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 03f505ac:d5a96bac:5d4da761:810ad4a6
           Name : jupiter:0  (local to host jupiter)
  Creation Time : Tue Aug 15 12:04:05 2023
     Raid Level : raid5
   Raid Devices : 6

 Avail Dev Size : 39063382016 (18626.87 GiB 20000.45 GB)
     Array Size : 97658455040 (93134.36 GiB 100002.26 GB)
    Data Offset : 264192 sectors
   Super Offset : 8 sectors
   Unused Space : before=264088 sectors, after=0 sectors
          State : clean
    Device UUID : 22b3d070:6d3a7111:ceeb75e4:4f70cc8d

Internal Bitmap : 8 sectors from superblock
    Update Time : Sun Sep 24 15:54:46 2023
  Bad Block Log : 512 entries available at offset 88 sectors
       Checksum : 9d314027 - correct
         Events : 93761

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 4
   Array State : ..AAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdf1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 03f505ac:d5a96bac:5d4da761:810ad4a6
           Name : jupiter:0  (local to host jupiter)
  Creation Time : Tue Aug 15 12:04:05 2023
     Raid Level : raid5
   Raid Devices : 6

 Avail Dev Size : 39063382016 (18626.87 GiB 20000.45 GB)
     Array Size : 97658455040 (93134.36 GiB 100002.26 GB)
    Data Offset : 264192 sectors
   Super Offset : 8 sectors
   Unused Space : before=264088 sectors, after=0 sectors
          State : clean
    Device UUID : 304c168f:5f981d99:1777b5dc:67771ac8

Internal Bitmap : 8 sectors from superblock
    Update Time : Sun Sep 24 15:54:46 2023
  Bad Block Log : 512 entries available at offset 88 sectors
       Checksum : 75b0c98b - correct
         Events : 93761

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 5
   Array State : ..AAAA ('A' == active, '.' == missing, 'R' == replacing)

Displaying UUID values for comparision.

Code Block
rdlab@exxact:/home# blkid
/dev/nvme1n1p1: UUID="7ca82a8b-e49f-4af2-9e45-ca84ffcf8d52" TYPE="ext4" PARTUUID="1b1fd338-33d6-4409-8f73-c28fe5b64c9d"
/dev/nvme0n1p1: UUID="C232-F548" TYPE="vfat" PARTUUID="bb710908-76b9-4722-bcbc-3326cc0eb476"
/dev/nvme0n1p2: UUID="6070f6d4-8edf-4032-b0d3-e9709be0326e" TYPE="ext4" PARTUUID="8801aa80-aef8-460b-86fd-46e3eeefa2df"
/dev/nvme0n1p3: UUID="7639e5c3-3fcb-4b5b-953e-58461c5b9fb9" TYPE="swap" PARTUUID="0791fca0-00fa-47e6-ab49-fab51c3c4137"
/dev/nvme0n1p4: UUID="7f5dfbfd-e027-4073-81a6-758484ecc019" TYPE="ext4" PARTUUID="eaa3624b-6ab6-4005-b645-8bf4dccdf6ba"
/dev/sda1: UUID="03f505ac-d5a9-6bac-5d4d-a761810ad4a6" UUID_SUB="1ce2160d-9a4d-9d85-acfb-481a360faccc" LABEL="jupiter:0" TYPE="linux_raid_member" PARTUUID="4058a593-2465-4406-bd4b-ea7e5600be4f"
/dev/sdd1: UUID="03f505ac-d5a9-6bac-5d4d-a761810ad4a6" UUID_SUB="043ea22c-0b07-2966-70a4-8109b02cfdb2" LABEL="jupiter:0" TYPE="linux_raid_member" PARTUUID="948c488a-ce92-4bbb-8fb5-590cf8f37703"
/dev/sdb1: UUID="03f505ac-d5a9-6bac-5d4d-a761810ad4a6" UUID_SUB="936b1233-4370-fef4-a5b0-0addad78d8bf" LABEL="jupiter:0" TYPE="linux_raid_member" PARTUUID="af27a600-c4e0-4de7-bd8c-322f32bb056c"
/dev/sdc1: UUID="03f505ac-d5a9-6bac-5d4d-a761810ad4a6" UUID_SUB="cadf27f8-3814-e183-fd4c-0a6e01a1908b" LABEL="jupiter:0" TYPE="linux_raid_member" PARTUUID="e45e7f5f-577f-46bf-92f2-f72103f0da5a"
/dev/sdf1: UUID="03f505ac-d5a9-6bac-5d4d-a761810ad4a6" UUID_SUB="304c168f-5f98-1d99-1777-b5dc67771ac8" LABEL="jupiter:0" TYPE="linux_raid_member" PARTUUID="69ae0247-dc71-47fa-bcef-855bf7672fdb"
/dev/sde1: UUID="03f505ac-d5a9-6bac-5d4d-a761810ad4a6" UUID_SUB="22b3d070-6d3a-7111-ceeb-75e44f70cc8d" LABEL="jupiter:0" TYPE="linux_raid_member" PARTUUID="5eaebad0-b8a8-4ae1-a6a9-4ffa7988e95b"
/dev/loop0: TYPE="squashfs"
/dev/loop1: TYPE="squashfs"
/dev/loop2: TYPE="squashfs"
/dev/loop3: TYPE="squashfs"
/dev/loop4: TYPE="squashfs"
/dev/loop5: TYPE="squashfs"

Conclusion

The drives are still identified as RAID5, but the configuration is RAID0. At this point of the investigation, it was decided to wipe out the existing /dev/md127 (RAID0) with associated devices and re-create the RAID5 configuration.

REF: ZD-4301 / ZD-6131 / ZD-6713 / ZD-7113