ORA-15041 : diskgroup space exhausted

ORA-15041: diskgroup "DATA01" space exhausted: appeared on the database

ASMCMD-08016: copy source->'+DATA01/db/datafile/ts_db_summary_index005.dbf' and target->'+DATA01/db/datafile/ts_db_summary_index005.dbf' failed
ORA-19505: failed to identify file "+DATA01/db/datafile/ts_db_summary_index005.dbf"
ORA-17502: ksfdcre:4 Failed to create file +DATA01/db/datafile/ts_db_summary_index005.dbf
ORA-15041: diskgroup "DATA01" space exhausted
ORA-06512: at "SYS.X$DBMS_DISKGROUP", line 410
ORA-06512: at line 3 (DBD ERROR: OCIStmtExecute)
copying knudwdbp1:+DATA01/db/datafile/ts_db_summary_index006.dbf -> +DATA01/db/datafile/ts_db_summary_index006.dbf
Argument "normal" isn't numeric in numeric ge (>=) at /u01/app/product/grid/11.2.0/lib/asmcmdshare.pm line 1676.
errors

----------------------------------

Initial investigation indicated there is around 650GB free space in disk group but still failed to create 1GB file.

Detailed analysis of space usage revealed there wer 29 disks  in the diskgroup and 2 of disk were 100%. All disk are of same size but two still managed to filled 100%.

So even 27 disk still got 50% free space Oracle still error out ORA-15041.  Running the re balance operation managed to fix the issue.

I know we normally check freespace in diskgroup but sometime its worth checking free space in individual disk in diskgroup to ensure disk are full balanced in term of space utilization. 

Note: Oracle/ASM doesn't store data unevenly its must be manual error , when somebody stopped to Re Balance operation due to whatever reason and never run again.

Thanks

krishan