exacqVision Server Log – SysMgmtPI Error/Warning “1073741819”
Description
Both warning and error messages containing Error -1073741819 found in the exacqVision Server logs.
Product
exacqVision Enterprise Manager
exacqVision Server
MegaRAID
Solution
The issue was first observed in exacqVision Enterprise Manager which was reporting a Storage Hardware Alarm
Note: This server had recently undergone MegaRAID Storage Manager (MSM) replacement with LSI Storage Authority (LSA) KB #7236 and it is suspected this may have been a contributing factor.
The exacqVision Client storage page was showing the status for all physical drives in the drive group as Offline
Restarted the exacqVision Server Service
Checked the System Logs, filtering on “sysmgmtpi” and focusing on entries immediately after restart
Found the following entries
Opened a command prompt and ran the same storcli command
A popup window immediately appeared saying “storcli.exe has stopped working”
Resolved by replacing the existing “C:\Program Files (x86)\MegaRAID Storage Manager\storcli.exe” file
Now works in a Command Prompt, no SysMgmtPI errors or warning after service restart and Storage Hardware tab is correct.
StorCLI.zip contains a working StorCLI.exe file and can be downloaded from the related tab on Salesforce Article #000034807
•This procedure applies to replacing the first non-RAID storage drive (mechanical SATA hard disk drive) on an Ubuntu Linux-based exacqVision server. If the operating system ROOT partition is 8GB or smaller, the replacement primary storage drive will need to have the “Linux swap”, “export”, and first “storage” partitions created on it. •These instructions assume that the Linux operating system is installed to an on-board solid-state drive (SSD) and can be successfully logged into with an administrator account. •This procedure is not intended for simply adding a new storage drive to a fully functional system.
Product
exacqVision Ubuntu Linux non-RAID Servers
Solution:
A. Verifying the size of the Root partition is 8 GB or smaller
The root partition size will need to be verified before completing the replacement task properly. Open Terminal and specify the command: df -h
In this example, the root directory “/” is located on the “/dev/sda3” partition which has a size of “55 GB.” If the root partition is 8 GB or less, continue with this document.
If, however, the root partition is 20 GB or greater, please obtain Support Portal Knowledge Base Number 10048 – “Replacing the First Storage Drive using GParted on a Non-RAID exacqVision Ubuntu Linux Server having a 20 GB or larger ROOT partition.”
B. Temporarily Disabling the Original Drive Mount Point Listed in the fstab File
Type the command sudo gedit /etc/fstab in Terminal and press the enter key to edit the file.
# /etc/fstab: static file system information. # # Use ‘blkid’ to print the universally unique identifier for a # device; this may be used with UUID= as a more robust way to name devices # that works even if disks are added and removed. See fstab(5). # # <file system> <mount point> <type> <options> <dump> <pass> # / was on /dev/sda3 during installation UUID=36a8d968-7e63-4859-a91b-0fdfcc319d3a / ext4 errors=remount-ro 0 1 # /boot/efi was on /dev/sda1 during installation UUID=DDF2-8CC6 /boot/efi vfat umask=0077 0 1 # /home was on /dev/sda2 during installation UUID=bc7b3ed7-7dfd-4530-972a-9c3269ea624b /home ext4 defaults 0 2 # /mnt/export was on /dev/sda4 during installation UUID=e4638d65-fbe8-407c-a9e8-6c3da0bed19c /mnt/export ext4 defaults 0 2 /swapfile none swap sw 0 0 LABEL=/mnt/edvr/1 /mnt/edvr/1 ext4 relatime,errors=remount-ro,noauto,x-systemd.automount 0 0
2. Locate and add a “# ” remark character and a space to the beginning of the line for “/mnt/edvr/1”. Save the file.
3. Type the command sudo reboot in Terminal to restart the exacqVision Server.
C. Partitioning the First Non-RAID Storage Drive using GParted
Open a Terminal session. Type the command sudogparted and press the enter key. If prompted for a password, use the admin account password.
Select the empty hard drive from the drop-down list in the top-right corner. Note that the drive is unallocated, which indicates that you have selected the correct hard drive. Select Create Partition Table from the Device menu.
3. Select Advanced in the Create Partition Table dialog. Select gpt from the Select New Partition Table Type drop-down list. Click Apply.
4. Right-click in the unallocated space and select New to open the Create New Partition window. Select 20000 in the New Size (MiB) box. Select linux-swap in the File System drop-down list. In the Label field, type swap. Click Add.
5. Right-click the unallocated space and select New to open the Create New Partition window. Select 10000 in the New Size (MiB) box. Select ext4 in the File System drop-down list. In the Label field, type /mnt/export. Click Add.
6. Right-click the unallocated space and select New to open the Create New Partition window. Select the highest available number in the Set New Size (MiB) box. Make sure Free Space Preceding and Free Space Following are both zero or 1. Select ext4 in the File System drop-down list. In the Label field, type /mnt/edvr/1. Click Add.
7. Click the green checkmark at the top of the screen and then click Apply. Wait for the operations to complete. Click on the Close button.
8. Close GParted. 9. In the terminal window, enter the following commands.
sudo service edvrserver stop sudo mount –a
10. To create your export directories and change ownership:
sudo mkdir /mnt/export/admin sudo mkdir /mnt/export/user sudo chown admin /mnt/export/admin sudo chown user /mnt/export/user sudo service edvrserver start
11. In a Terminal window, enter the following commands:
Type the command sudo reboot in Terminal to restart the exacqVision Server. If prompted for a password, use the admin account password (admin256 by default).
D. The replaced drive may display as “Offline” in the Storage Page
(A) If the old drive DOES NOT display as “Offline” in the Storage Page then the procedure is considered complete. (B) If the old drive DOES display as “Offline” then continue below.
Run exacqVision Client and check the Storage configuration. You should see the new drive in the list of attached storage devices. The replaced drive displays as “Offline” which requires editing the <sysmgmtpi.xml> file located in the path: /usr/local/exacq/server to remove the corresponding entries. Click on the “Offline” disk and note the model number and serial number for this purpose. Close the exacqVision Client.
Open a Terminal session. Type the command sudo service edvrserver stop and press the enter key to stop the server service.
Type the command cd /usr/local/exacq/server/ and press the enter key.
Type the command sudo cp -via sysmgmtpi.xml sysmgmtpi.bak and press the enter key to back-up the original file.
Type the command sudo gedit sysmgmtpi.xml and press the enter key. Scroll down and remove the lines (between and including the xml tags < Disk Name = > and < / Disk >) for the corresponding “Offline” hard disk drive model number and serial number noted previously with exacqVision Client. It should lack any < Attribute > tags.
The section to be removed in our example: < Disk Name = “WD-WCC4M4VYN3E5” Model=”WDC WD20PURZ-85GU6Y0″ SerialNumber=”WD-WCC4M4VYN3E5″ FirmwareVersion=”” DriverVersion=”” Capacity=”-1″ SmartAvailable=”-1″ SmartEnabled=”-1″ ControllerName=”” UnitName=”” OtherName=”” Speed=”-1″ LinkSpeed=”-1.000000″ Hotspare=”0″ CanConfigureHotSpare=”0″ Attached=”0″ NonRaidPort=”2″ SupportsPrep=”0″> < Thresholds > < Threshold Id = “194” Min=”5″ Max=”55″ /> < /Thresholds > < /Disk >
“Save” the changes and “Close” the gedit window.
Type the command sudo service edvrserver start and press the enter key to start the server service.
Close the Terminal window.
Run exacqVision Client and check the Storage configuration is free of the “Offline” hard disk drive entry.
•This procedure applies to replacing the first non-RAID storage drive (mechanical SATA hard disk drive) on an Ubuntu Linux-based exacqVision server. If the operating system ROOT partition is 20GB or larger, the replacement storage drive will only need to have the first “storage” partition created on it. •These instructions assume that the Linux operating system is installed to an on-board solid-state drive (SSD) and can be successfully logged into with an administrator account. •This procedure is not intended for simply adding a new storage drive to a fully functional system.
Product
exacqVision Ubuntu Linux non-RAID Servers
Solution:
A. Verifying the size of the Root partition is 20 GB or larger
The root partition size will need to be verified to complete the replacement task properly. Open Terminal and specify the command: df -h
In this example, the root directory “/” is located on the “/dev/sda3” partition which has a size of “55 GB.” If the root partition is 20 GB or larger, continue with this document. If, however, the root partition is 8 GB or smaller, please obtain Support Portal Knowledge Base Number 10050 – “Replacing the First Storage Drive using GParted on a Non-RAID exacqVision Ubuntu Linux Server having an 8 GB or smaller ROOT partition“.
B. Temporarily Disabling the Original Drive Mount Point Listed in the fstab File
Type the command sudo gedit /etc/fstab in Terminal and press the enter key to edit the file.
# /etc/fstab: static file system information. # # Use ‘blkid’ to print the universally unique identifier for a # device; this may be used with UUID= as a more robust way to name devices # that works even if disks are added and removed. See fstab(5). # # <file system> <mount point> <type> <options> <dump> <pass> # / was on /dev/sda3 during installation UUID=36a8d968-7e63-4859-a91b-0fdfcc319d3a / ext4 errors=remount-ro 0 1 # /boot/efi was on /dev/sda1 during installation UUID=DDF2-8CC6 /boot/efi vfat umask=0077 0 1 # /home was on /dev/sda2 during installation UUID=bc7b3ed7-7dfd-4530-972a-9c3269ea624b /home ext4 defaults 0 2 # /mnt/export was on /dev/sda4 during installation UUID=e4638d65-fbe8-407c-a9e8-6c3da0bed19c /mnt/export ext4 defaults 0 2 /swapfile none swap sw 0 0 LABEL=/mnt/edvr/1 /mnt/edvr/1 ext4 relatime,errors=remount-ro,noauto,x-systemd.automount 0 0
2. Locate and add a “# ” remark character and a space to the beginning of the line for “/mnt/edvr/1”. Save the file and closed the text editor.
3. Type the command sudo reboot in Terminal to restart the exacqVision Server. If prompted for a password, use the admin account password (admin256 by default).
C. Partitioning the First Non-RAID Storage Drive using GParted
Open a Terminal session. Type the command sudogparted and press the enter key. If prompted for a password, use the admin account password.
Select the empty hard drive from the drop-down list in the top-right corner. Note that the drive is unallocated, which indicates that you have selected the newly installed hard disk drive. Select Create Partition Table from the Device menu.
In the Create Partition Table dialog, select gpt from the “Select New Partition Table Type” drop-down list. Click Apply
Right-click the unallocated space and select New to open the Create New Partition window. Select the highest available number in the New Size (MiB) box. Make sure Free Space Preceding and Free Space Following are both at the minimum value allowed (zero or 1). Select “ext4” in the File System drop-down list. In the Label field, type “/mnt/edvr/1”. Click the “Add” button. Click the green checkmark icon near the top of the screen.
Click on “Apply” and wait for the operations to complete. Click on the Close button. Close Gparted.
Type the command sudo gedit /etc/fstab in Terminal and press the enter key to edit the file.
Type the command sudo reboot in Terminal to restart the exacqVision Server. If prompted for a password, use the admin account password (admin256 by default).
D. The replaced drive may display as “Offline” in the Storage Page
(A) If the old drive DOES NOT display as “Offline” in the Storage Page then the procedure is considered complete. (B) If the old drive DOES display as “Offline” then continue below.
Run exacqVision Client and check the Storage configuration. You should see the new drive in the list of attached storage devices. The replaced drive displays as “Offline” which requires editing the < sysmgmtpi.xml > file located in the path: /usr/local/exacq/server to remove the corresponding entries. Click on the “Offline” disk and note the model number and serial number for this purpose. Close the exacqVision Client.
Open a Terminal session. Type the command sudo service edvrserver stop and press the enter key to stop the server service.
Type the command cd /usr/local/exacq/server/ and press the enter key.
Type the command sudo cp -via sysmgmtpi.xml sysmgmtpi.bak and press the enter key to back-up the original file.
Type the command sudo gedit sysmgmtpi.xml and press the enter key. Scroll down and remove the lines (between and including the xml tags < Disk Name = > and < /Disk >) for the corresponding “Offline” hard disk drive model number and serial number noted previously with exacqVision Client. It should lack any < Attribute > tags.
The section to be removed in our example: < Disk Name = “WD-WCC4M4VYN3E5” Model=”WDC WD20PURZ-85GU6Y0″ SerialNumber=”WD-WCC4M4VYN3E5″ FirmwareVersion=”” DriverVersion=”” Capacity=”-1″ SmartAvailable=”-1″ SmartEnabled=”-1″ ControllerName=”” UnitName=”” OtherName=”” Speed=”-1″ LinkSpeed=”-1.000000″ Hotspare=”0″ CanConfigureHotSpare=”0″ Attached=”0″ NonRaidPort=”2″ SupportsPrep=”0″> < Thresholds > < Threshold Id = “194” Min=”5″ Max=”55″ /> < /Thresholds > < /Disk >
“Save” the changes and “Close” the gedit window.
Type the command sudo service edvrserver start and press the enter key to start the server service.
Close the Terminal window.
Run exacqVision Client and check the Storage configuration is free of the “Offline” hard disk drive entry.
Replacing MegaRAID Storage Manager (MSM) With LSI Storage Authority (LSA) – Linux
Description
MSM has been found to have some exposure to CVE-2021-44228, the Apache Log4j remote code execution vulnerability, see statement from Broadcom Log4j2 Exposure (CVE-2021-44228). As a result you may be able to replace MSM with LSA on a Windows machine using the following instructions.
Product
MegaRAID 92xx Series RAID Controllers
MegaRAID 93xx Series RAID Controllers
Ubuntu 16.04 LTS and Earlier
Ubuntu 18.04 LTS
Ubunutu 20.04 LTS
Prerequisites
First determine which version of Ubuntu the NVR is currently running using Knowledge Base Article #9996 “How to Identify the Current Linux OS Version”
Next identify the RAID controller model using Knowledge Base Article #7244 “How to Identify the MegaRAID Controller Model on an exacqVision Server”
Ubuntu 16.04 LTS or earlier Operating Systems
Broadcom has not provided an LSA version for 16.04 LTS or older versions of Ubuntu.
If possible, Re-image using Ubuntu 18.04 or 20.04 LTS
The LSI website will require reading a download agreement, (scrolling down to the bottom of the agreement), clicking an acknowledgement checkbox, then clicking the “I Agree” button
Once downloaded, close Firefox
On the desktop double-click the Computer icon.
Select Downloads, locate and right-click on the LSA zip file and select extract here
Right-click the newly created x64 folder and select Open as Administrator
A caution window may appear, click OK to continue
Enter the Administrator Password and click Authenticate
Click File menu and Select Open in Terminal
In the terminal window type ./install_deb.sh and press Enter
The License agreement (EULA) will be displayed
Type Y to accept the License Agreement then press Enter
Type 1 to choose “Since last shutdown” and press Enter
Type 2 to choose “Standalone” and press Enter
Type 2463 for Web Server port and press Enter
Type 9000 for LSA Port and press Enter
Type Y and press Enter to install openslp
When you see “LSA installation successful” the install is complete
Close the Terminal window
Edit the Desktop Icon
Right-click on the MSM desktop icon and select properties
When experiencing Errors partitioning additional storage after a RAID array has been expanded or partition issues with either Archiving or Extended storage drives on an S-Series Server. Check the partitions for errors using parted.
Product
exacqVision Server
Linux
Steps to Reproduce
Open Terminal from the machine hosting the storage drives.
Run the parted command to list the partition layout on all block devices.
parted command example
Expected Results
The results return the partition layout on all block devices with no Errors
Actual Results
The command returns an Error
The language may vary but the GPT table is always indicated.
Error: The backup GPT table is not at the end of the disk
Error: The backup GPT table is corrupt, but the primary appears OK, so that will be used.
In this example the GPT Table error is referring to the partition listed immediately after you are required to type OK to continue, in this case /dev/sdb.
Solution
From Terminal run the gdisk command on the partition with the GPT Table Error
You will be prompted with the following, the responses are in bold
Command (? for help): x
Expert command (? for help): e
Expert command (? for help): w
Do you want to proceed? (Y/N): Y
Once the command completes, reboot the system.
Run parted -l again (see above) to ensure there are no more GPT Table Errors.
Meaning of the UBAD or UGOOD messages, most commonly seen in RAID Controller, but may appear in Storage.
Product
exacqVision Server
Information
UGOOD (Unconfigured Good)
This means a drive has been found that does not have a RAID configuration, but was not automatically imported into the RAID as a replacement drive.<br><br>
UBAD (Unconfigured Bad)
A drive may enter this state if it was unexpectedly powered off or disconnected. The drive should be re-seated and imported back into the array.
If the problem returns, the drive should be swapped with another drive, then follow the problem to diagnose.<br><br>
Solution
If the same disk, moved to another slot, goes back to the UBAD status, the disk itself is bad. Replace the drive.
If the previously good drive, moved into the same slot, goes into a UBAD state, the backplane or cabling may be the problem. Check the cabling. If the cabling looks okay and is seated properly, RMA/Repair the machine.
Meaning of Foreign Configuration message from RAID
Product
ExacqVision Server
Information
Each drive in RAID Controller’s configuration has a bit of information about the controller it is on written to it. Sometimes, a RAID Controller will detect that information about a controller exists on one or more of the drives, but it does not match what the controller expects.
Solution
If the customer has moved hard disks from one machine to another:
If the customer does not need the data from the newly inserted drives, the Foreign Configuration can be cleared, and the newly added drives can be imported into the RAID.
If the RAID Controller has been replaced:
The Foreign Configuration should be imported from the Drives into the RAID Controller.
The RAID Controller undergoes a normal cycle to periodically drain the power from the board’s backup battery to test its ability to provide power when needed. This cycle is referred to a ‘relearn’.
Meaning of BBU (Backup Battery Unit) Failure message
Product
ExacqVision Server
Information
Battery Backup failure means that the on-board RAID Controller’s battery is bad and should be replaced. In many cases, this may mean replacing the entire RAID card due to restrictions on shipping batteries. Confirm that any cables connecting the BBU to the RAID Controller are securely connected.
Solution
Replace the BBU, or the RAID Controller if the stand-alone battery cannot be shipped.
