ERROR:- ORA-27154, ORA-27300, ORA-27301 & ORA-27302
After rebooting one cluster node, ASM instance came up fine but database instance failed with:
SYS@xxxx > startup nomount
ORA-27154: post/wait create failed
ORA-27300: OS system dependent operation:semget failed with status: 28
ORA-27301: OS failure message: No space left on device
ORA-27302: failure occurred at: sskgpcreates
The semaphore settings caused problems.
It turned out the kernel settings were insufficient.
It turned out the kernel settings were insufficient.
Solution:
cat /etc/sysctl.conf
kernel.sem = 250 32000 100 128
This line needs to be changed to:
kernel.sem = 250 32000 100 256
Note the change of the last number from 128 to 256.
After that applying the settings is done as root with:
sysctl -p
After that instances came up just fine.
SYS@MRA> startup nomount
ORACLE instance started.
Total System Global Area 1536602112 bytes
Fixed Size 2253504 bytes
Variable Size 905973056 bytes
Database Buffers 620756992 bytes
Redo Buffers 7618560 bytes
SYS@MRA>