正常运行日志记录：timestep好像没有，模拟day=1:
[acox11ust1@login01 jibinghu]$ ./AllocateNode.sh 2
salloc: Pending job allocation 3898
salloc: job 3898 queued and waiting for resources
salloc: job 3898 has been allocated resources
salloc: Granted job allocation 3898
salloc: Waiting for resource configuration
salloc: Nodes a01r3n[31-32] are ready for job
[acox11ust1@login01 jibinghu]$ cd fv3_source/ics_231207_checked/pubrel/
[acox11ust1@login01 pubrel]$ ./fv3run.sh
WARNING: INCLUDE_modshare exists ( /opt/hpc/software/mpi/hpcx/v2.12.0/ucx_without_rocm/include:1:/opt/hpc/software/mpi/hpcx/v2.12.0/gcc-8.3.1/include:1:/opt/hpc/software/mpi/hpcx/v2.12.0/sharp/include:1:/opt/hpc/software/mpi/hpcx/v2.12.0/hcoll/include:1 ), but INCLUDE doesn't. Environment is corrupted.
[0] MPI startup(): Intel(R) MPI Library, Version 2021.3 Build 20210601 (id: 6f90181f1)
[0] MPI startup(): Copyright (C) 2003-2021 Intel Corporation. All rights reserved.
[0] MPI startup(): library kind: release
[0] MPI startup(): libfabric version: 1.12.1-impi
[0] MPI startup(): libfabric provider: verbs;ofi_rxm
[0] MPI startup(): File "/public/software/mpi/intelmpi/2021.3.0/etc/tuning_generic_shm-ofi_verbs-ofi-rxm.dat" not found
[0] MPI startup(): Load tuning file: "/public/software/mpi/intelmpi/2021.3.0/etc/tuning_generic_shm-ofi.dat"
[0] MPI startup(): Rank Pid Node name Pin cpu
[0] MPI startup(): 0 29878 a01r3n31 {0,1,2,3,4,5,6,7}
[0] MPI startup(): 1 29879 a01r3n31 {8,9,10,11,12,13,14,15}
[0] MPI startup(): 2 29880 a01r3n31 {16,17,18,19,20,21,22,23}
[0] MPI startup(): 3 23881 a01r3n32 {24,25,26,27,28,29,30,31}
[0] MPI startup(): 4 23882 a01r3n32 {0,1,2,3,4,5,6,7}
[0] MPI startup(): 5 23883 a01r3n32 {8,9,10,11,12,13,14,15}
[0] MPI startup(): I_MPI_ROOT=/public/software/mpi/intelmpi/2021.3.0
[0] MPI startup(): I_MPI_MPIRUN=mpirun
[0] MPI startup(): I_MPI_HYDRA_TOPOLIB=hwloc
[0] MPI startup(): I_MPI_HYDRA_BOOTSTRAP=slurm
[0] MPI startup(): I_MPI_INTERNAL_MEM_POLICY=default
[0] MPI startup(): I_MPI_FABRICS=shm:ofi
[0] MPI startup(): I_MPI_DEBUG=5
[0] MPI startup(): I_MPI_STACKSIZE environment variable is not supported.
[0] MPI startup(): To check the list of supported variables, use the impi_info utility or refer to https://software.intel.com/en-us/mpi-library/documentation/get-started.
NOTE from PE 0: MPP_DOMAINS_SET_STACK_SIZE: stack size set to 32768.
&MPP_IO_NML
HEADER_BUFFER_VAL = 16384,
GLOBAL_FIELD_ON_ROOT_PE = T,
IO_CLOCKS_ON = F
/
NOTE from PE 0: MPP_IO_SET_STACK_SIZE: stack size set to 131072.
NOTE from PE 0: MPP_DOMAINS_SET_STACK_SIZE: stack size set to 900000.
Memuse(MB) at fms_init= 5.050E+01 6.396E+01 5.368E+00 5.787E+01
Starting PEs : 6
Starting Threads : 0
Cubic: cubed-sphere domain decomposition
whalo = 3, ehalo = 3, shalo = 3, nhalo = 3
X-AXIS = 96
Y-AXIS = 96
Cubic: cubed-sphere domain decomposition
Cubic: cubed-sphere domain decomposition
whalo = 3, ehalo = 3, shalo = 3, nhalo = 3
X-AXIS = 96
Y-AXIS = 96
whalo = 3, ehalo = 3, shalo = 3, nhalo = 3
X-AXIS = 96
Y-AXIS = 96
Cubic: cubed-sphere domain decomposition
whalo = 3, ehalo = 3, shalo = 3, nhalo = 3
X-AXIS = 96
Y-AXIS = 96
Cubic: cubed-sphere domain decomposition
whalo = 3, ehalo = 3, shalo = 3, nhalo = 3
X-AXIS = 96
Y-AXIS = 96
Cubic: cubed-sphere domain decomposition
whalo = 1, ehalo = 1, shalo = 1, nhalo = 1
X-AXIS = 96
Cubic: cubed-sphere domain decomposition
whalo = 1, ehalo = 1, shalo = 1, nhalo = 1
X-AXIS = 96
Y-AXIS = 96
Y-AXIS = 96
Cubic: cubed-sphere domain decomposition
whalo = 1, ehalo = 1, shalo = 1, nhalo = 1
X-AXIS = 96
Y-AXIS = 96
Cubic: cubed-sphere domain decomposition
whalo = 1, ehalo = 1, shalo = 1, nhalo = 1
X-AXIS = 96
Y-AXIS = 96
Cubic: cubed-sphere domain decomposition
whalo = 1, ehalo = 1, shalo = 1, nhalo = 1
X-AXIS = 96
Y-AXIS = 96
For k_split (remapping)= 1
n_split is set to 11 for resolution-dt=0097x0097x6- 1800.000
Using n_sponge : 01
Using non_ortho : T
NOTE from PE 0: MPP_DOMAINS_SET_STACK_SIZE: stack size set to 4000000.
Cubic: cubed-sphere domain decomposition
whalo = 3, ehalo = 3, shalo = 3, nhalo = 3
X-AXIS = 96
Y-AXIS = 96
Cubic: cubed-sphere domain decomposition
whalo = 1, ehalo = 1, shalo = 1, nhalo = 1
X-AXIS = 96
Y-AXIS = 96
ncnst= 4 num_prog= 4 pnats= 0 num_family=
0
MAX AREA (m*m): 0.13344276151023E+11 MIN AREA (m*m): 0.58324265963307E+10
GLOBAL AREA (m*m): 0.51006447191034E+15 IDEAL GLOBAL AREA (m*m): 0.51006447190979E+15
Cubed-Sphere Grid Stats : 97 x 97 x 6
Grid Length : min: 81692.11 max: 115523.76 avg: 96476.08 min/max: 0.71
Deviation from Orthogonal : min: 0.00 max: 29.55 avg: 8.81
Aspect Ratio : min: 1.00 max: 1.07 avg: 1.02
da_max/da_min= 2.28794583705834
da_max_c/da_min_c= 2.29849446388365
Divergence damping Coefficients * 1.E6:
For small dt= 163.636363636364
External mode del-2 (m**2/s)= 0.709638939210312
Internal mode del-2 SMAG dimensionless coeff= 0.000000000000000E+000
Internal mode del-2 background diff= 0.000000000000000E+000
Internal mode del-8 background diff= 0.160000000000000
Vorticity del-4 (m**4/s)= 0.000000000000000E+000
0001 0.29531250000000E-02 0.49062500000000E+01 0.26531068145124E+03
0002 0.88239419291339E-02 0.12741633858268E+02 0.26663476584496E+03
0003 0.16659325787402E-01 0.20577017716535E+02 0.25754289850161E+03
0004 0.24494709645669E-01 0.28412401574803E+02 0.24721823575178E+03
0005 0.32330093503937E-01 0.36247785433071E+02 0.23783995617442E+03
0006 0.40165477362205E-01 0.44083169291339E+02 0.22992925585823E+03
0007 0.48000861220472E-01 0.51918553149606E+02 0.22355776798706E+03
0008 0.55836245078740E-01 0.59753937007874E+02 0.21863652802440E+03
0009 0.63671628937008E-01 0.67589320866142E+02 0.21501508409462E+03
0010 0.71507012795276E-01 0.75424704724409E+02 0.21252273383047E+03
0011 0.79342396653543E-01 0.83260088582677E+02 0.21098775502103E+03
0012 0.87177780511811E-01 0.91095472440945E+02 0.21024694342577E+03
0013 0.95013164370079E-01 0.98930856299213E+02 0.21015040297888E+03
0014 0.10284854822835E+00 0.10676624015748E+03 0.21056381478277E+03
0015 0.11068393208661E+00 0.11460162401575E+03 0.21136927894282E+03
0016 0.11851931594488E+00 0.12243700787402E+03 0.21246530557160E+03
0017 0.12635469980315E+00 0.13027239173228E+03 0.21376627627899E+03
0018 0.13419008366142E+00 0.13810777559055E+03 0.21520156395382E+03
0019 0.14202546751969E+00 0.14594315944882E+03 0.21671442508611E+03
0020 0.14986085137795E+00 0.15377854330709E+03 0.21826073655931E+03
0021 0.15769623523622E+00 0.16161392716535E+03 0.21980762356864E+03
0022 0.16553161909449E+00 0.16944931102362E+03 0.22133200972997E+03
0023 0.17336700295276E+00 0.17728469488189E+03 0.22281911054638E+03
0024 0.18120238681102E+00 0.18512007874016E+03 0.22426088495564E+03
0025 0.18903777066929E+00 0.19295546259843E+03 0.22565445539093E+03
0026 0.19687315452756E+00 0.20079084645669E+03 0.22700050387063E+03
0027 0.20470853838583E+00 0.20862623031496E+03 0.22830165072567E+03
0028 0.21254392224409E+00 0.21646161417323E+03 0.22956096134074E+03
0029 0.22037930610236E+00 0.22429699803150E+03 0.23078125105127E+03
0030 0.22821468996063E+00 0.23213238188976E+03 0.23196505382612E+03
0031 0.23605007381890E+00 0.23996776574803E+03 0.23311465885249E+03
0032 0.24388545767717E+00 0.24780314960630E+03 0.23423214142593E+03
0033 0.25172084153543E+00 0.25563853346457E+03 0.23531938908579E+03
0034 0.25955622539370E+00 0.26347391732283E+03 0.23637812385185E+03
0035 0.26739160925197E+00 0.27130930118110E+03 0.23740992124250E+03
0036 0.27522699311024E+00 0.27914468503937E+03 0.23841622662021E+03
0037 0.28306237696850E+00 0.28698006889764E+03 0.23939836930448E+03
0038 0.29089776082677E+00 0.29481545275591E+03 0.24035757481004E+03
0039 0.29873314468504E+00 0.30265083661417E+03 0.24129497550260E+03
0040 0.30656852854331E+00 0.31048622047244E+03 0.24221161991265E+03
0041 0.31440391240157E+00 0.31832160433071E+03 0.24310848090584E+03
0042 0.32223929625984E+00 0.32615698818898E+03 0.24398646287519E+03
0043 0.33007468011811E+00 0.33399237204724E+03 0.24484640809291E+03
0044 0.33791006397638E+00 0.34182775590551E+03 0.24568910233754E+03
0045 0.34574544783465E+00 0.34966313976378E+03 0.24651527989373E+03
0046 0.35358083169291E+00 0.35749852362205E+03 0.24732562800726E+03
0047 0.36141621555118E+00 0.36533390748031E+03 0.24812079086520E+03
0048 0.36925159940945E+00 0.37316929133858E+03 0.24890137316105E+03
0049 0.37708698326772E+00 0.38100467519685E+03 0.24966794329580E+03
0050 0.38492236712598E+00 0.38884005905512E+03 0.25042103625908E+03
0051 0.39275775098425E+00 0.39667544291339E+03 0.25116115622785E+03
0052 0.40059313484252E+00 0.40451082677165E+03 0.25188877891570E+03
0053 0.40842851870079E+00 0.41234621062992E+03 0.25260435370085E+03
0054 0.41626390255906E+00 0.42018159448819E+03 0.25330830555754E+03
0055 0.42409928641732E+00 0.42801697834646E+03 0.25400103681243E+03
0056 0.43193467027559E+00 0.43585236220472E+03 0.25468292874463E+03
0057 0.43977005413386E+00 0.44368774606299E+03 0.25535434304592E+03
0058 0.44760543799213E+00 0.45152312992126E+03 0.25601562315568E+03
0059 0.45544082185039E+00 0.45935851377953E+03 0.25666709548318E+03
0060 0.46327620570866E+00 0.46719389763779E+03 0.25730907052850E+03
0061 0.47111158956693E+00 0.47502928149606E+03 0.25794184391219E+03
0062 0.47894697342520E+00 0.48286466535433E+03 0.25856569732224E+03
0063 0.48678235728346E+00 0.49070004921260E+03 0.25918089938651E+03
0064 0.49461774114173E+00 0.49853543307087E+03 0.25978770647736E+03
0065 0.50245312500000E+00 0.50637081692913E+03 0.26038636345486E+03
0066 0.51028850885827E+00 0.51420620078740E+03 0.26097710435410E+03
0067 0.51812389271654E+00 0.52204158464567E+03 0.26156015302163E+03
0068 0.52595927657480E+00 0.52987696850394E+03 0.26213572370543E+03
0069 0.53379466043307E+00 0.53771235236220E+03 0.26270402160257E+03
0070 0.54163004429134E+00 0.54554773622047E+03 0.26326524336796E+03
0071 0.54946542814961E+00 0.55338312007874E+03 0.26381957758775E+03
0072 0.55730081200787E+00 0.56121850393701E+03 0.26436720522003E+03
0073 0.56513619586614E+00 0.56905388779527E+03 0.26490830000570E+03
0074 0.57297157972441E+00 0.57688927165354E+03 0.26544302885185E+03
0075 0.58080696358268E+00 0.58472465551181E+03 0.26597155218981E+03
0076 0.58864234744094E+00 0.59256003937008E+03 0.26649402430990E+03
0077 0.59647773129921E+00 0.60039542322835E+03 0.26701059367469E+03
0078 0.60431311515748E+00 0.60823080708661E+03 0.26752140321235E+03
0079 0.61214849901575E+00 0.61606619094488E+03 0.26802659059174E+03
0080 0.61998388287402E+00 0.62390157480315E+03 0.26852628848037E+03
0081 0.62781926673228E+00 0.63173695866142E+03 0.26902062478669E+03
0082 0.63565465059055E+00 0.63957234251968E+03 0.26950972288782E+03
0083 0.64349003444882E+00 0.64740772637795E+03 0.26999370184364E+03
0084 0.65132541830709E+00 0.65524311023622E+03 0.27047267659832E+03
0085 0.65916080216535E+00 0.66307849409449E+03 0.27094675817022E+03
0086 0.66699618602362E+00 0.67091387795275E+03 0.27141605383074E+03
0087 0.67483156988189E+00 0.67874926181102E+03 0.27188066727316E+03
0088 0.68266695374016E+00 0.68658464566929E+03 0.27234069877194E+03
0089 0.69050233759843E+00 0.69442002952756E+03 0.27279624533321E+03
0090 0.69833772145669E+00 0.70225541338583E+03 0.27324740083700E+03
0091 0.70617310531496E+00 0.71009079724409E+03 0.27369425617176E+03
0092 0.71400848917323E+00 0.71792618110236E+03 0.27413689936169E+03
0093 0.72184387303150E+00 0.72576156496063E+03 0.27457541568731E+03
0094 0.72967925688976E+00 0.73359694881890E+03 0.27500988779969E+03
0095 0.73751464074803E+00 0.74143233267716E+03 0.27544039582877E+03
0096 0.74535002460630E+00 0.74926771653543E+03 0.27586701748610E+03
0097 0.75318540846457E+00 0.75710310039370E+03 0.27628982816242E+03
0098 0.76102079232283E+00 0.76493848425197E+03 0.27670890102025E+03
0099 0.76885617618110E+00 0.77277386811024E+03 0.27712430708191E+03
0100 0.77669156003937E+00 0.78060925196850E+03 0.27753611531325E+03
0101 0.78452694389764E+00 0.78844463582677E+03 0.27794439270322E+03
0102 0.79236232775591E+00 0.79628001968504E+03 0.27834920433965E+03
0103 0.80019771161417E+00 0.80411540354331E+03 0.27875061348139E+03
0104 0.80803309547244E+00 0.81195078740157E+03 0.27914868162704E+03
0105 0.81586847933071E+00 0.81978617125984E+03 0.27954346858047E+03
0106 0.82370386318898E+00 0.82762155511811E+03 0.27993503251326E+03
0107 0.83153924704724E+00 0.83545693897638E+03 0.28032343002430E+03
0108 0.83937463090551E+00 0.84329232283465E+03 0.28070871619671E+03
0109 0.84721001476378E+00 0.85112770669291E+03 0.28109094465209E+03
0110 0.85504539862205E+00 0.85896309055118E+03 0.28147016760244E+03
0111 0.86288078248031E+00 0.86679847440945E+03 0.28184643589976E+03
0112 0.87071616633858E+00 0.87463385826772E+03 0.28221979908342E+03
0113 0.87855155019685E+00 0.88246924212598E+03 0.28259030542551E+03
0114 0.88638693405512E+00 0.89030462598425E+03 0.28295800197428E+03
0115 0.89422231791339E+00 0.89814000984252E+03 0.28332293459560E+03
0116 0.90205770177165E+00 0.90597539370079E+03 0.28368514801280E+03
0117 0.90989308562992E+00 0.91381077755905E+03 0.28404468584473E+03
0118 0.91772846948819E+00 0.92164616141732E+03 0.28440159064230E+03
0119 0.92556385334646E+00 0.92948154527559E+03 0.28475590392351E+03
0120 0.93339923720472E+00 0.93731692913386E+03 0.28510766620696E+03
0121 0.94123462106299E+00 0.94515231299213E+03 0.28545691704414E+03
0122 0.94907000492126E+00 0.95298769685039E+03 0.28580369505029E+03
0123 0.95690538877953E+00 0.96082308070866E+03 0.28614803793411E+03
0124 0.96474077263780E+00 0.96865846456693E+03 0.28648998252628E+03
0125 0.97257615649606E+00 0.97649384842520E+03 0.28682956480679E+03
0126 0.98041154035433E+00 0.98432923228346E+03 0.28716681993132E+03
0127 0.98824692421260E+00 0.99216461614173E+03 0.28750178225652E+03
0128 0.99608230807087E+00 0.10000000000000E+04 0.28783448536432E+03
Global Area= 510064471910337.
mean terrain height (m)= 9.913626027322558E-004
Total surface pressure (mb) = 999.999999999994
fv_restart u = 5967028512594690453
fv_restart v = -7692853242191799093
fv_restart delp = -2181994019463161856
fv_restart phis = 4914991103180051783
fv_restart pt = 7433948930651974799
fv_init nq = 4 -6715205138635554816
ZS max = 112.874125463318 min = -315.642117444664
PS max = 1000.00000000000 min = 1000.00000000000
T max = 309.808183006628 min = 209.223347977603
sphum max = 3.000000000000000E-006 min = 3.000000000000000E-006
liq_wat max = 3.000000000000000E-006 min = 3.000000000000000E-006
ice_wat max = 3.000000000000000E-006 min = 3.000000000000000E-006
cld_amt max = 3.000000000000000E-006 min = 3.000000000000000E-006
U max = 34.9989158484801 min = -34.9989158484801
V max = 34.9989158484801 min = -34.9989161814653
lin_cld_micrphys diagnostics initialized.
Memuse(MB) at atmos_model_init= 4.475E+02 4.507E+02 1.045E+00 4.488E+02
-----------------------------------------------------
Block User time System Time Total Time
-----------------------------------------------------
TOTAL 557.3864 0.0000 557.3864
FV_RESTART 49.2071 0.0000 49.2071
COMM_TOTAL 11.9754 0.0000 11.9754
FV_DYNAMICS 493.9743 0.0000 493.9743
C_SW 29.4985 0.0000 29.4985
D_SW 369.5266 0.0000 369.5266
TRACER_2D 19.4567 0.0000 19.4567
COMM_TRAC 0.2039 0.0000 0.2039
REMAPPING 16.3683 0.0000 16.3683
FV_PHYS 7.2409 0.0000 7.2409
UPDATE_PHYS 2.6932 0.0000 2.6932
UPDATE_DWINDS 0.5913 0.0000 0.5913
FV_DIAG 6.2811 0.0000 6.2811
fv_restart_end u = 4397989828267125978
fv_restart_end v = -2842069540584071737
fv_restart_end delp = -4009613896373628800
fv_restart_end phis = 4914991103180051783
fv_restart_end pt = -1339724932053717564
fv_restart_end q = -1678801284657576475
fv_restart_end q = -1678801284657576475
fv_restart_end q = -1678801284657576475
fv_restart_end q = -1678801284657576475
ZS max = 112.874125463318 min = -315.642117444664
PS max = 1004.54794746194 min = 997.822097387793
U max = 34.1102598743495 min = -34.1191210572457
V max = 34.1153036160876 min = -34.1306921330178
T max = 310.695396957274 min = 208.953556948708
NOTE from PE 0: mpp_io_connect.inc(mpp_open): io_domain exists for domain Cubic: cubed-sphere, optional argument fileset will be ignored
NOTE from PE 0: MPP_IO_SET_STACK_SIZE: stack size set to 1191936.
NOTE from PE 0: mpp_io_connect.inc(mpp_open): io_domain exists for domain Cubic: cubed-sphere, optional argument fileset will be ignored
NOTE from PE 0: mpp_io_connect.inc(mpp_open): io_domain exists for domain Cubic: cubed-sphere, optional argument fileset will be ignored
NOTE from PE 0: mpp_io_connect.inc(mpp_open): io_domain exists for domain Cubic: cubed-sphere, optional argument fileset will be ignored
NOTE from PE 0: mpp_io_connect.inc(mpp_open): io_domain exists for domain Cubic: cubed-sphere, optional argument fileset will be ignored
NOTE from PE 0: mpp_io_connect.inc(mpp_open): io_domain exists for domain Cubic: cubed-sphere, optional argument fileset will be ignored
NOTE from PE 0: mpp_io_connect.inc(mpp_open): io_domain exists for domain Cubic: cubed-sphere, optional argument fileset will be ignored
NOTE from PE 0: mpp_io_connect.inc(mpp_open): io_domain exists for domain Cubic: cubed-sphere, optional argument fileset will be ignored
MPP_DOMAINS_STACK high water mark= 2383872
Tabulating mpp_clock statistics across 6 PEs...
tmin tmax tavg tstd tfrac grain pemin pemax
Total runtime 558.533781 558.536034 558.534790 0.000830 1.000 0 0 5
MAIN: initialization 50.204609 50.208829 50.205556 0.001470 0.090 1 0 5
MAIN: time loop 507.182123 507.190412 507.184842 0.003189 0.908 1 0 5
MAIN: termination 0.600257 0.905622 0.742618 0.121957 0.001 1 0 5
Lin_cld_microphys 0.000000 0.000000 0.000000 0.000000 0.000 41 0 5
MPP_STACK high water mark= 0