SGA+PGA 用到了物理内存的 80%

Begin        End

Host Mem (MB):         262,144.0         262,144.0

SGA use (MB):         204,800.0         204,800.0

PGA use (MB):         3,377.0         5,685.4

% Host Mem used for SGA+PGA:         79.41         80.29

Event        Waits        %Time -outs        Total Wait Time (s)        Avg wait (ms)        Waits /txn        % bg time

db file parallel write        538,429        0        5,612        10        0.25        11.90

gcs log flush sync        583,193        63        5,158        9        0.27        10.94

gcs log flush sync 超时比例达到63%

Global Cache and Enqueue Services - Workload Characteristics

Avg global enqueue get time (ms):         0.0

Avg global cache cr block receive time (ms):         0.8

Avg global cache current block receive time (ms):         0.7

Avg global cache cr block build time (ms):         0.0

Avg global cache cr block send time (ms):         0.0

Global cache log flushes for cr blocks served %:         0.0

Avg global cache cr block flush time (ms):

Avg global cache current block pin time (ms):         545.7

Avg global cache current block send time (ms):         0.0

Global cache log flushes for current blocks served %:         0.3

Avg global cache current block flush time (ms):         4,922.9

Global Cache and Enqueue Services - Messaging Statistics

Avg message sent queue time (ms):         0.1

Avg message sent queue time on ksxp (ms):         3.3

Avg message received queue time (ms):         0.1

Avg GCS message process time (ms):         0.1

Avg GES message process time (ms):         0.0

% of direct sent messages:         55.58

% of indirect sent messages:         43.44

% of flow controlled messages:         0.98

Avg global cache current block flush time (ms):         4,922.9

Avg message sent queue time on ksxp (ms):         3.3

心跳网络的状况不好，

IOStat by Function summary

'Data' columns suffixed with M,G,T,P are in multiples of 1024 other columns suffixed with K,M,G,T,P are in multiples of 1000

ordered by (Data Read + Write) desc

Function Name        Reads: Data        Reqs per sec        Data per sec        Writes: Data        Reqs per sec        Data per sec        Waits: Count        Avg Tm(ms)

Others        34.7G        30.87        2.46551        30.7G        6.59        2.18212        434.3K        1.79

DBWR        0M        0.00        0M        50.9G        179.60        3.61591        0

Buffer Cache Reads        43.6G        348.35        3.09509        0M        0.00        0M        4998.8K        14.86

LGWR        8M        0.09        .000554        30.4G        76.55        2.15550        947.7K        6.88

Direct Writes        3M        0.00        .000207        1.6G        0.67        .116461        0

Direct Reads        410M        0.71        .028422        109M        0.09        .007556        0

TOTAL:        78.7G        380.02        5.58979        113.8G        263.51        8.07755        6380.8K        12.79

考虑：

1、关闭一个节点并观察现象

2、使用IO calibrate测一下IO