heartbeat[8011]: 2006/03/27_11:46:31 WARN: Core dumps could be lost if multiple dumps occur heartbeat[8011]: 2006/03/27_11:46:31 WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability heartbeat[8011]: 2006/03/27_11:46:31 WARN: Traditional compression selected. Realtime behavior will likely be impacted(!) heartbeat[8011]: 2006/03/27_11:46:31 info: See http://linux-ha.org/ha.cf/TraditionalCompressionDirective for more information. heartbeat[8011]: 2006/03/27_11:46:31 WARN: Logging daemon is disabled --enabling logging daemon is recommended heartbeat[8011]: 2006/03/27_11:46:31 info: ************************** heartbeat[8011]: 2006/03/27_11:46:31 info: Configuration validated. Starting heartbeat 2.0.4 heartbeat[8012]: 2006/03/27_11:46:31 info: heartbeat: version 2.0.4 heartbeat[8012]: 2006/03/27_11:46:31 info: Heartbeat generation: 183 heartbeat[8012]: 2006/03/27_11:46:31 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[8012]: 2006/03/27_11:46:31 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[8012]: 2006/03/27_11:46:31 info: Removing /var/run/heartbeat/rsctmp failed, recreating. heartbeat[8012]: 2006/03/27_11:46:31 info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth1 heartbeat[8012]: 2006/03/27_11:46:31 info: glib: UDP Broadcast heartbeat closed on port 694 interface eth1 - Status: 1 heartbeat[8012]: 2006/03/27_11:46:31 info: G_main_add_SignalHandler: Added signal handler for signal 17 heartbeat[8012]: 2006/03/27_11:46:31 info: Local status now set to: 'up' heartbeat[8012]: 2006/03/27_11:46:31 info: Link node1:eth1 up. heartbeat[8012]: 2006/03/27_11:46:31 info: Exiting write_hostcachedata process 8018 returned rc 0. heartbeat[8012]: 2006/03/27_11:46:47 WARN: node node2: is dead heartbeat[8012]: 2006/03/27_11:46:47 info: Comm_now_up(): updating status to active heartbeat[8012]: 2006/03/27_11:46:47 info: Local status now set to: 'active' heartbeat[8012]: 2006/03/27_11:46:47 info: Starting child client "/usr/lib/heartbeat/ccm" (90,90) heartbeat[8012]: 2006/03/27_11:46:47 info: Starting child client "/usr/lib/heartbeat/cib" (90,90) heartbeat[8021]: 2006/03/27_11:46:47 info: Starting "/usr/lib/heartbeat/ccm" as uid 90 gid 90 (pid 8021) heartbeat[8012]: 2006/03/27_11:46:47 info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0) heartbeat[8022]: 2006/03/27_11:46:47 info: Starting "/usr/lib/heartbeat/cib" as uid 90 gid 90 (pid 8022) heartbeat[8012]: 2006/03/27_11:46:47 info: Starting child client "/usr/lib/heartbeat/lrmd" (0,0) heartbeat[8012]: 2006/03/27_11:46:47 info: Starting child client "/usr/lib/heartbeat/crmd" (90,90) heartbeat[8023]: 2006/03/27_11:46:47 info: Starting "/usr/lib/heartbeat/stonithd" as uid 0 gid 0 (pid 8023) heartbeat[8024]: 2006/03/27_11:46:47 info: Starting "/usr/lib/heartbeat/lrmd" as uid 0 gid 0 (pid 8024) heartbeat[8025]: 2006/03/27_11:46:47 info: Starting "/usr/lib/heartbeat/crmd" as uid 90 gid 90 (pid 8025) cib[8022]: 2006/03/27_11:46:47 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[8022]: 2006/03/27_11:46:47 info: G_main_add_TriggerHandler: Added signal manual handler cib[8022]: 2006/03/27_11:46:47 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[8022]: 2006/03/27_11:46:47 info: mask(main.c:main): Disk writes to /var/lib/heartbeat/crm/cib.xml: enabled cib[8022]: 2006/03/27_11:46:47 info: mask(main.c:main): Configuration changes logged at: debug 0 cib[8022]: 2006/03/27_11:46:47 info: mask(main.c:cib_register_ha): Signing in with Heartbeat cib[8022]: 2006/03/27_11:46:47 info: mask(main.c:cib_register_ha): FSA Hostname: node1 cib[8022]: 2006/03/27_11:46:47 info: mask(io.c:readCibXmlFile): Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml ccm[8021]: 2006/03/27_11:46:47 info: Hostname: node1 lrmd[8024]: 2006/03/27_11:46:47 info: G_main_add_SignalHandler: Added signal handler for signal 15 crmd[8025]: 2006/03/27_11:46:47 WARN: Core dumps could be lost if multiple dumps occur crmd[8025]: 2006/03/27_11:46:47 WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability crmd[8025]: 2006/03/27_11:46:47 info: mask(main.c:init_start): Starting crmd stonithd[8023]: 2006/03/27_11:46:47 WARN: Core dumps could be lost if multiple dumps occur lrmd[8024]: 2006/03/27_11:46:47 info: G_main_add_SignalHandler: Added signal handler for signal 17 stonithd[8023]: 2006/03/27_11:46:47 WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability crmd[8025]: 2006/03/27_11:46:47 info: G_main_add_SignalHandler: Added signal handler for signal 15 lrmd[8024]: 2006/03/27_11:46:47 WARN: Core dumps could be lost if multiple dumps occur lrmd[8024]: 2006/03/27_11:46:47 WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability stonithd[8023]: 2006/03/27_11:46:47 info: G_main_add_SignalHandler: Added signal handler for signal 10 stonithd[8023]: 2006/03/27_11:46:47 info: G_main_add_SignalHandler: Added signal handler for signal 12 lrmd[8024]: 2006/03/27_11:46:47 info: G_main_add_SignalHandler: Added signal handler for signal 10 lrmd[8024]: 2006/03/27_11:46:47 info: G_main_add_SignalHandler: Added signal handler for signal 12 lrmd[8024]: 2006/03/27_11:46:47 info: Started. crmd[8025]: 2006/03/27_11:46:47 info: G_main_add_TriggerHandler: Added signal manual handler crmd[8025]: 2006/03/27_11:46:47 info: G_main_add_SignalHandler: Added signal handler for signal 17 crmd[8025]: 2006/03/27_11:46:47 WARN: mask(cib_native.c:cib_native_signon): Connection to CIB failed: connection failed crmd[8025]: 2006/03/27_11:46:47 WARN: mask(cib.c:do_cib_control): Couldn't complete CIB registration 1 times... pause and retry crmd[8025]: 2006/03/27_11:46:47 info: mask(main.c:init_start): Starting crmd's mainloop cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 info: mask(readCibXmlFile): [on-disk] cib[8022]: 2006/03/27_11:46:47 WARN: mask(xml.c:find_xml_node): Could not find status in cib. cib[8022]: 2006/03/27_11:46:47 info: mask(main.c:startCib): CIB Initialization completed successfully cib[8022]: 2006/03/27_11:46:47 WARN: mask(main.c:init_start): CCM Activation failed cib[8022]: 2006/03/27_11:46:47 WARN: mask(main.c:init_start): CCM Connection failed 1 times (30 max) stonithd[8023]: 2006/03/27_11:46:48 info: G_main_add_SignalHandler: Added signal handler for signal 17 ccm[8021]: 2006/03/27_11:46:48 info: n_member=1, nodecount=2 ccm[8021]: 2006/03/27_11:46:48 info: Break tie for 2 nodes cluster ccm[8021]: 2006/03/27_11:46:48 info: G_main_add_SignalHandler: Added signal handler for signal 15 crmd[8025]: 2006/03/27_11:46:48 info: mask(utils.c:crm_timer_popped): Wait Timer (I_NULL) just popped! cib[8022]: 2006/03/27_11:46:49 info: mask(main.c:init_start): Starting cib mainloop cib[8022]: 2006/03/27_11:46:49 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[8022]: 2006/03/27_11:46:49 info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3 cib[8022]: 2006/03/27_11:46:49 info: mask(callbacks.c:cib_ccm_msg_callback): New peer: node1 cib[8026]: 2006/03/27_11:46:49 info: mask(io.c:write_cib_contents): Writing version 0.89.33798 of the CIB to disk crmd[8025]: 2006/03/27_11:46:49 info: mask(cib.c:do_cib_control): CIB connection established cib[8022]: 2006/03/27_11:46:49 info: mask(callbacks.c:cib_null_callback): Setting cib_refresh_notify callbacks for crmd: on crmd[8025]: 2006/03/27_11:46:49 info: mask(control.c:register_with_ha): Hostname: node1 cib[8022]: 2006/03/27_11:46:49 info: mask(callbacks.c:cib_client_status_callback): Status update: Client node1/cib now has status [join] cib[8022]: 2006/03/27_11:46:49 info: mask(callbacks.c:cib_client_status_callback): Status update: Client node1/cib now has status [online] crmd[8025]: 2006/03/27_11:46:49 info: mask(control.c:register_with_ha): UUID: b82eb33c-c94c-4262-a17b-a3dfb774055b crmd[8025]: 2006/03/27_11:46:50 info: mask(control.c:register_with_ha): Requesting the list of configured nodes crmd[8025]: 2006/03/27_11:46:51 notice: mask(control.c:register_with_ha): Node: node2 (uuid: 374fc145-ac35-4556-9b75-767e2babf9a4) crmd[8025]: 2006/03/27_11:46:51 notice: mask(control.c:register_with_ha): Node: node1 (uuid: b82eb33c-c94c-4262-a17b-a3dfb774055b) crmd[8025]: 2006/03/27_11:46:51 info: mask(control.c:do_ha_control): Connected to Heartbeat cib[8022]: 2006/03/27_11:46:51 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw crmd[8025]: 2006/03/27_11:46:51 info: mask(ccm.c:do_ccm_control): CCM connection established... waiting for first callback crmd[8025]: 2006/03/27_11:46:51 info: mask(control.c:do_started): Delaying start, CCM (0000000000100000) not connected cib[8027]: 2006/03/27_11:46:51 info: mask(io.c:write_cib_contents): Writing version 0.89.33798 of the CIB to disk crmd[8025]: 2006/03/27_11:46:51 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[8025]: 2006/03/27_11:46:51 info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3 crmd[8025]: 2006/03/27_11:46:51 info: mask(callbacks.c:crmd_ccm_msg_callback): Quorum (re)attained after event=NEW MEMBERSHIP (id=1) crmd[8025]: 2006/03/27_11:46:51 info: mask(ccm.c:ccm_event_detail): NEW MEMBERSHIP: trans=1, nodes=1, new=1, lost=0 n_idx=0, new_idx=0, old_idx=3 crmd[8025]: 2006/03/27_11:46:51 info: mask(ccm.c:ccm_event_detail): CURRENT: node1 [nodeid=0, born=1] crmd[8025]: 2006/03/27_11:46:51 info: mask(ccm.c:ccm_event_detail): NEW: node1 [nodeid=0, born=1] crmd[8025]: 2006/03/27_11:46:51 info: mask(control.c:do_started): Delaying start, Peer data (0000000000200000) not recieved crmd[8025]: 2006/03/27_11:46:51 notice: mask(callbacks.c:crmd_client_status_callback): Status update: Client node1/crmd now has status [online] cib[8022]: 2006/03/27_11:46:51 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw crmd[8025]: 2006/03/27_11:46:51 notice: mask(callbacks.c:crmd_client_status_callback): Status update: Client node1/crmd now has status [online] crmd[8025]: 2006/03/27_11:46:51 info: mask(control.c:do_started): The local CRM is operational crmd[8025]: 2006/03/27_11:46:51 info: mask(fsa.c:do_state_transition): State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_started ] crmd[8025]: 2006/03/27_11:46:51 info: mask(utils.c:update_dc): Set DC to () cib[8022]: 2006/03/27_11:46:51 info: mask(notify.c:cib_diff_notify): Local-only Change (client:8025, call: 5): 0.89.33798 (ok) cib[8022]: 2006/03/27_11:46:51 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:46:51 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:46:51 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:46:51 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:46:51 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:46:51 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8022]: 2006/03/27_11:46:51 info: mask(notify.c:cib_diff_notify): Local-only Change (client:8025, call: 6): 0.89.33798 (ok) cib[8022]: 2006/03/27_11:46:51 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:46:51 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:46:51 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:46:51 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:46:51 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:46:51 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:46:51 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:46:51 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:46:51 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:46:51 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:46:51 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8028]: 2006/03/27_11:46:51 info: mask(io.c:write_cib_contents): Writing version 0.89.33798 of the CIB to disk crmd[8025]: 2006/03/27_11:46:52 info: mask(utils.c:crm_timer_popped): Wait Timer (I_NULL) just popped! crmd[8025]: 2006/03/27_11:47:52 info: mask(utils.c:crm_timer_popped): Election Trigger (I_DC_TIMEOUT) just popped! crmd[8025]: 2006/03/27_11:47:52 WARN: mask(misc.c:do_log): [[FSA]] Input I_DC_TIMEOUT from crm_timer_popped() received in state (S_PENDING) crmd[8025]: 2006/03/27_11:47:52 info: mask(fsa.c:do_state_transition): State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ] crmd[8025]: 2006/03/27_11:47:52 info: mask(utils.c:update_dc): Set DC to () crmd[8025]: 2006/03/27_11:47:52 info: mask(election.c:do_election_count_vote): Updated voted hash for node1 to vote crmd[8025]: 2006/03/27_11:47:52 info: mask(election.c:do_election_count_vote): Election ignore: our vote crmd[8025]: 2006/03/27_11:47:52 info: mask(fsa.c:do_state_transition): State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ] crmd[8025]: 2006/03/27_11:47:52 info: mask(subsystems.c:start_subsystem): Starting sub-system "tengine" crmd[8025]: 2006/03/27_11:47:52 info: mask(subsystems.c:start_subsystem): Starting sub-system "pengine" crmd[8025]: 2006/03/27_11:47:52 info: mask(election.c:do_dc_takeover): Taking over DC status for this partition cib[8022]: 2006/03/27_11:47:52 info: mask(messages.c:cib_process_readwrite): We are now in R/W mode crmd[8025]: 2006/03/27_11:47:52 info: mask(join_dc.c:do_dc_join_offer_all): join-1: Waiting on 1 outstanding join acks cib[8022]: 2006/03/27_11:47:52 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8022]: 2006/03/27_11:47:52 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:11): 0.89.33798 -> 0.89.33799 (ok) cib[8022]: 2006/03/27_11:47:52 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:52 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:52 info: G_main_add_SignalHandler: Added signal handler for signal 15 pengine[8030]: 2006/03/27_11:47:52 info: G_main_add_SignalHandler: Added signal handler for signal 15 tengine[8029]: 2006/03/27_11:47:52 info: G_main_add_TriggerHandler: Added signal manual handler pengine[8030]: 2006/03/27_11:47:52 info: mask(main.c:init_start): Starting pengine cib[8022]: 2006/03/27_11:47:52 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8022]: 2006/03/27_11:47:52 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:12): 0.89.33799 -> 0.89.33800 (ok) cib[8022]: 2006/03/27_11:47:52 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:52 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:52 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:52 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:52 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:52 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:52 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:52 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:52 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:52 info: mask(cib:diff): + cib[8031]: 2006/03/27_11:47:52 info: mask(io.c:write_cib_contents): Writing version 0.89.33800 of the CIB to disk cib[8022]: 2006/03/27_11:47:52 info: mask(callbacks.c:cib_null_callback): Setting cib_diff_notify callbacks for tengine: on tengine[8029]: 2006/03/27_11:47:52 info: mask(main.c:init_start): Registering TE UUID: dea3df60-8040-459f-bd73-6490b76c412f tengine[8029]: 2006/03/27_11:47:52 info: mask(utils.c:set_graph_functions): Setting custom graph functions tengine[8029]: 2006/03/27_11:47:52 info: mask(unpack.c:unpack_graph): Unpacked transition -1: 0 actions in 0 synapses tengine[8029]: 2006/03/27_11:47:52 info: mask(main.c:init_start): Starting tengine crmd[8025]: 2006/03/27_11:47:52 info: mask(fsa.c:do_state_transition): State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] crmd[8025]: 2006/03/27_11:47:52 info: mask(fsa.c:do_state_transition): All 1 cluster nodes responded to the join offer. cib[8022]: 2006/03/27_11:47:52 info: mask(messages.c:sync_our_cib): Syncing CIB to all peers cib[8022]: 2006/03/27_11:47:52 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8022]: 2006/03/27_11:47:52 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:15): 0.89.33800 -> 0.89.33801 (ok) cib[8022]: 2006/03/27_11:47:52 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:52 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:52 info: mask(callbacks.c:te_update_diff): Processing diff (cib_update): 0.89.33800 -> 0.89.33801 cib[8022]: 2006/03/27_11:47:52 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_bump operation from 8025/cib_rw cib[8022]: 2006/03/27_11:47:52 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:16): 0.89.33801 -> 0.90.33802 (ok) cib[8022]: 2006/03/27_11:47:52 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:52 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:52 info: mask(callbacks.c:te_update_diff): Processing diff (cib_bump): 0.89.33801 -> 0.90.33802 cib[8022]: 2006/03/27_11:47:52 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8022]: 2006/03/27_11:47:52 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:17): 0.90.33802 -> 0.90.33803 (ok) cib[8022]: 2006/03/27_11:47:52 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:52 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:52 info: mask(callbacks.c:te_update_diff): Processing diff (cib_update): 0.90.33802 -> 0.90.33803 cib[8032]: 2006/03/27_11:47:52 info: mask(io.c:write_cib_contents): Writing version 0.90.33803 of the CIB to disk crmd[8025]: 2006/03/27_11:47:53 info: mask(join_dc.c:do_dc_join_ack): join-1: Updating node state to member for node1) cib[8022]: 2006/03/27_11:47:53 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8022]: 2006/03/27_11:47:53 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:18): 0.90.33803 -> 0.90.33804 (ok) cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:53 info: mask(callbacks.c:te_update_diff): Processing diff (cib_update): 0.90.33803 -> 0.90.33804 cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + crmd[8025]: 2006/03/27_11:47:53 info: mask(fsa.c:do_state_transition): State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] crmd[8025]: 2006/03/27_11:47:53 info: mask(fsa.c:do_state_transition): All 1 cluster nodes are eligable to run resources. cib[8033]: 2006/03/27_11:47:53 info: mask(io.c:write_cib_contents): Writing version 0.90.33804 of the CIB to disk tengine[8029]: 2006/03/27_11:47:53 info: mask(utils.c:update_abort_priority): Abort priority upgraded to 1000000 tengine[8029]: 2006/03/27_11:47:53 info: mask(utils.c:abort_transition_graph): process_te_message:230 - Triggered graph processing : Peer Cancelled pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [generation] pengine[8030]: 2006/03/27_11:47:53 info: mask(unpack.c:unpack_config): Default stickiness: 0 pengine[8030]: 2006/03/27_11:47:53 WARN: mask(unpack.c:unpack_config): No value specified for cluster preference: stonith_enabled pengine[8030]: 2006/03/27_11:47:53 info: mask(unpack.c:unpack_config): STONITH of failed nodes is disabled pengine[8030]: 2006/03/27_11:47:53 info: mask(unpack.c:unpack_config): Cluster is symmetric - resources can run anywhere by default pengine[8030]: 2006/03/27_11:47:53 info: mask(unpack.c:unpack_config): Using short resource names: true pengine[8030]: 2006/03/27_11:47:53 info: mask(unpack.c:unpack_config): On loss of CCM Quorum: Stop ALL resources pengine[8030]: 2006/03/27_11:47:53 info: mask(unpack.c:unpack_config): Orphan resources are ignored pengine[8030]: 2006/03/27_11:47:53 info: mask(unpack.c:unpack_config): Orphan resource actions are stopped pengine[8030]: 2006/03/27_11:47:53 info: mask(unpack.c:unpack_config): Stopped resources are removed from the status section: false pengine[8030]: 2006/03/27_11:47:53 info: mask(unpack.c:unpack_config): By default resources are managed pengine[8030]: 2006/03/27_11:47:53 info: Resource Group: heartbeat_group_1 pengine[8030]: 2006/03/27_11:47:53 info: IPaddr_1 (heartbeat::ocf:IPaddr): NOT ACTIVE pengine[8030]: 2006/03/27_11:47:53 info: drbd_2 (heartbeat::heartbeat:datadisk): NOT ACTIVE pengine[8030]: 2006/03/27_11:47:53 info: Filesystem_3 (heartbeat::ocf:Filesystem): NOT ACTIVE pengine[8030]: 2006/03/27_11:47:53 info: smb_4 (heartbeat::heartbeat:smb): NOT ACTIVE pengine[8030]: 2006/03/27_11:47:53 info: nfsserver_5 (heartbeat::heartbeat:nfsserver): NOT ACTIVE pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:native_create_probe): node1: Created probe for IPaddr_1 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:native_create_probe): node1: Created probe for drbd_2 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:native_create_probe): node1: Created probe for Filesystem_3 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:native_create_probe): node1: Created probe for smb_4 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:native_create_probe): node1: Created probe for nfsserver_5 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:StartRsc): node1 Start IPaddr_1 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:Recurring): node1 IPaddr_1_monitor_5000 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:StartRsc): node1 Start drbd_2 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:Recurring): node1 drbd_2_monitor_120000 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:StartRsc): node1 Start Filesystem_3 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:Recurring): node1 Filesystem_3_monitor_120000 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:StartRsc): node1 Start smb_4 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:Recurring): node1 smb_4_monitor_120000 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:StartRsc): node1 Start nfsserver_5 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:Recurring): node1 nfsserver_5_monitor_120000 pengine[8030]: 2006/03/27_11:47:53 info: mask(stages.c:stage8): Created transition graph 0. pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] crmd[8025]: 2006/03/27_11:47:53 info: mask(fsa.c:do_state_transition): State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=do_msg_route ] tengine[8029]: 2006/03/27_11:47:53 info: mask(unpack.c:unpack_graph): Unpacked transition 0: 19 actions in 19 synapses tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:initiate_action): Executing rsc-event: 3 tengine[8029]: 2006/03/27_11:47:53 info: mask(actions.c:send_rsc_command): Initiating action 3: IPaddr_1_monitor_0 on node1 tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:initiate_action): Executing rsc-event: 4 tengine[8029]: 2006/03/27_11:47:53 info: mask(actions.c:send_rsc_command): Initiating action 4: drbd_2_monitor_0 on node1 tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:initiate_action): Executing rsc-event: 5 tengine[8029]: 2006/03/27_11:47:53 info: mask(actions.c:send_rsc_command): Initiating action 5: Filesystem_3_monitor_0 on node1 tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:initiate_action): Executing rsc-event: 6 tengine[8029]: 2006/03/27_11:47:53 info: mask(actions.c:send_rsc_command): Initiating action 6: smb_4_monitor_0 on node1 tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:initiate_action): Executing rsc-event: 7 tengine[8029]: 2006/03/27_11:47:53 info: mask(actions.c:send_rsc_command): Initiating action 7: nfsserver_5_monitor_0 on node1 crmd[8025]: 2006/03/27_11:47:53 info: mask(lrm.c:do_lrm_rsc_op): Performing op monitor on IPaddr_1 (interval=0ms) crmd[8025]: 2006/03/27_11:47:53 info: mask(lrm.c:do_lrm_rsc_op): Performing op monitor on drbd_2 (interval=0ms) crmd[8025]: 2006/03/27_11:47:53 info: mask(lrm.c:do_lrm_rsc_op): Performing op monitor on Filesystem_3 (interval=0ms) crmd[8025]: 2006/03/27_11:47:53 info: mask(lrm.c:do_lrm_rsc_op): Performing op monitor on smb_4 (interval=0ms) crmd[8025]: 2006/03/27_11:47:53 info: mask(lrm.c:do_lrm_rsc_op): Performing op monitor on nfsserver_5 (interval=0ms) lrmd[8024]: 2006/03/27_11:47:53 info: Resource Agent (operation monitor[3] on heartbeat::datadisk::drbd_2 for client 8025, its parameters: 1=[drbd0] te-target-rc=[7] lrm-is-probe=[true] crm_feature_set=[1.0.4] ): pid [8035] exited with return code 7 (mapped from 0) lrmd[8024]: 2006/03/27_11:47:53 info: Resource Agent output: [stopped ] crmd[8025]: 2006/03/27_11:47:53 info: mask(lrm.c:do_lrm_event): LRM operation (3) monitor_0 on drbd_2 Error: not running lrmd[8024]: 2006/03/27_11:47:53 info: Resource Agent (operation monitor[5] on heartbeat::smb::smb_4 for client 8025, its parameters: te-target-rc=[7] lrm-is-probe=[true] crm_feature_set=[1.0.4] ): pid [8039] exited with return code 7 (mapped from 3) lrmd[8024]: 2006/03/27_11:47:53 info: Resource Agent output: [..unused ] crmd[8025]: 2006/03/27_11:47:53 info: mask(lrm.c:do_lrm_event): LRM operation (5) monitor_0 on smb_4 Error: not running cib[8022]: 2006/03/27_11:47:53 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw lrmd[8024]: 2006/03/27_11:47:53 info: Resource Agent (operation monitor[4] on ocf::Filesystem::Filesystem_3 for client 8025, its parameters: directory=[/data] fstype=[reiserfs] te-target-rc=[7] device=[/dev/drbd0] lrm-is-probe=[true] crm_feature_set=[1.0.4] ): pid [8037] exited with return code 7 lrmd[8024]: 2006/03/27_11:47:53 info: Resource Agent output: [] crmd[8025]: 2006/03/27_11:47:53 info: mask(lrm.c:do_lrm_event): LRM operation (4) monitor_0 on Filesystem_3 Error: not running cib[8022]: 2006/03/27_11:47:53 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:20): 0.90.33804 -> 0.90.33805 (ok) cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + lrmd[8024]: 2006/03/27_11:47:53 info: Resource Agent (operation monitor[6] on heartbeat::nfsserver::nfsserver_5 for client 8025, its parameters: te-target-rc=[7] lrm-is-probe=[true] crm_feature_set=[1.0.4] ): pid [8041] exited with return code 7 (mapped from 3) cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + lrmd[8024]: 2006/03/27_11:47:53 info: Resource Agent output: [..unused ] cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:53 info: mask(callbacks.c:te_update_diff): Processing diff (cib_update): 0.90.33804 -> 0.90.33805 cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:update_synapse_confirmed): Confirmed: Action 4 of Synapse 5 cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:53 info: mask(events.c:match_graph_event): Action drbd_2_monitor_0 (4) confirmed crmd[8025]: 2006/03/27_11:47:53 info: mask(lrm.c:do_lrm_event): LRM operation (6) monitor_0 on nfsserver_5 Error: not running cib[8022]: 2006/03/27_11:47:53 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8022]: 2006/03/27_11:47:53 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:21): 0.90.33805 -> 0.90.33806 (ok) cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): - lrmd[8024]: 2006/03/27_11:47:53 info: Resource Agent (operation monitor[2] on ocf::IPaddr::IPaddr_1 for client 8025, its parameters: ip=[131.188.78.127] te-target-rc=[7] lrm-is-probe=[true] crm_feature_set=[1.0.4] ): pid [8034] exited with return code 7 lrmd[8024]: 2006/03/27_11:47:53 info: Resource Agent output: [] cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + crmd[8025]: 2006/03/27_11:47:53 info: mask(lrm.c:do_lrm_event): LRM operation (2) monitor_0 on IPaddr_1 Error: not running cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:53 info: mask(callbacks.c:te_update_diff): Processing diff (cib_update): 0.90.33805 -> 0.90.33806 tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:update_synapse_confirmed): Confirmed: Action 6 of Synapse 11 tengine[8029]: 2006/03/27_11:47:53 info: mask(events.c:match_graph_event): Action smb_4_monitor_0 (6) confirmed cib[8022]: 2006/03/27_11:47:53 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8022]: 2006/03/27_11:47:53 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:22): 0.90.33806 -> 0.90.33807 (ok) cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:53 info: mask(callbacks.c:te_update_diff): Processing diff (cib_update): 0.90.33806 -> 0.90.33807 tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:update_synapse_confirmed): Confirmed: Action 5 of Synapse 8 tengine[8029]: 2006/03/27_11:47:53 info: mask(events.c:match_graph_event): Action Filesystem_3_monitor_0 (5) confirmed cib[8022]: 2006/03/27_11:47:53 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8022]: 2006/03/27_11:47:53 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:23): 0.90.33807 -> 0.90.33808 (ok) cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:53 info: mask(callbacks.c:te_update_diff): Processing diff (cib_update): 0.90.33807 -> 0.90.33808 tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:update_synapse_confirmed): Confirmed: Action 7 of Synapse 14 tengine[8029]: 2006/03/27_11:47:53 info: mask(events.c:match_graph_event): Action nfsserver_5_monitor_0 (7) confirmed cib[8022]: 2006/03/27_11:47:53 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8022]: 2006/03/27_11:47:53 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:24): 0.90.33808 -> 0.90.33809 (ok) cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:53 info: mask(callbacks.c:te_update_diff): Processing diff (cib_update): 0.90.33808 -> 0.90.33809 tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:update_synapse_confirmed): Confirmed: Action 3 of Synapse 2 tengine[8029]: 2006/03/27_11:47:53 info: mask(events.c:match_graph_event): Action IPaddr_1_monitor_0 (3) confirmed tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:initiate_action): Executing rsc-event: 2 tengine[8029]: 2006/03/27_11:47:53 info: mask(actions.c:send_rsc_command): Initiating action 2: probe_complete on node1 tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:update_synapse_confirmed): Confirmed: Action 2 of Synapse 18 tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:initiate_action): Executing pseudo-event: 1 tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:update_synapse_confirmed): Confirmed: Action 1 of Synapse 17 tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:initiate_action): Executing pseudo-event: 18 tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:update_synapse_confirmed): Confirmed: Action 18 of Synapse 0 tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:initiate_action): Executing rsc-event: 8 tengine[8029]: 2006/03/27_11:47:53 info: mask(actions.c:send_rsc_command): Initiating action 8: IPaddr_1_start_0 on node1 crmd[8025]: 2006/03/27_11:47:53 info: mask(lrm.c:do_lrm_rsc_op): Performing op start on IPaddr_1 (interval=0ms) cib[8022]: 2006/03/27_11:47:53 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8073]: 2006/03/27_11:47:53 info: mask(io.c:write_cib_contents): Writing version 0.90.33809 of the CIB to disk cib[8022]: 2006/03/27_11:47:53 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:25): 0.90.33809 -> 0.90.33810 (ok) cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:53 info: mask(callbacks.c:te_update_diff): Processing diff (cib_update): 0.90.33809 -> 0.90.33810 tengine[8029]: 2006/03/27_11:47:53 info: mask(events.c:extract_event): Aborting on transient_attributes changes tengine[8029]: 2006/03/27_11:47:53 info: mask(utils.c:update_abort_priority): Abort priority upgraded to 1000000 tengine[8029]: 2006/03/27_11:47:53 info: mask(utils.c:update_abort_priority): Abort action 0 superceeded by 2 tengine[8029]: 2006/03/27_11:47:53 info: mask(utils.c:abort_transition_graph): extract_event:159 - Triggered graph processing : transient_attributes tengine[8029]: 2006/03/27_11:47:53 info: mask(abort_transition_graph): Cause tengine[8029]: 2006/03/27_11:47:53 info: mask(abort_transition_graph): Cause tengine[8029]: 2006/03/27_11:47:53 info: mask(abort_transition_graph): Cause tengine[8029]: 2006/03/27_11:47:53 info: mask(abort_transition_graph): Cause tengine[8029]: 2006/03/27_11:47:53 info: mask(abort_transition_graph): Cause tengine[8029]: 2006/03/27_11:47:53 info: mask(abort_transition_graph): Cause tengine[8029]: 2006/03/27_11:47:53 info: mask(abort_transition_graph): Cause cib[8077]: 2006/03/27_11:47:53 info: mask(io.c:write_cib_contents): Writing version 0.90.33810 of the CIB to disk IPaddr[8074]: 2006/03/27_11:47:53 INFO: /sbin/ifconfig eth0:0 131.188.78.127 netmask 255.255.254.0 IPaddr[8074]: 2006/03/27_11:47:53 INFO: Sending Gratuitous Arp for 131.188.78.127 on eth0:0 [eth0] IPaddr[8074]: 2006/03/27_11:47:53 INFO: /usr/lib/heartbeat/send_arp -i 500 -r 10 -p /var/run/heartbeat/rsctmp/send_arp/send_arp-131.188.78.127 eth0 131.188.78.127 auto 131.188.78.127 ffffffffffff crmd[8025]: 2006/03/27_11:47:53 info: mask(lrm.c:do_lrm_event): LRM operation (7) start_0 on IPaddr_1 complete cib[8022]: 2006/03/27_11:47:53 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8022]: 2006/03/27_11:47:53 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:26): 0.90.33810 -> 0.90.33811 (ok) cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:53 info: mask(callbacks.c:te_update_diff): Processing diff (cib_update): 0.90.33810 -> 0.90.33811 tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:update_synapse_confirmed): Confirmed: Action 8 of Synapse 3 tengine[8029]: 2006/03/27_11:47:53 info: mask(events.c:match_graph_event): Action IPaddr_1_start_0 (8) confirmed tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:run_graph): ==================================================== tengine[8029]: 2006/03/27_11:47:53 notice: mask(graph.c:run_graph): Transition 0 Complete: 9, Pending: 0, Fired: 0, Skipped: 10, Incomplete: 0 crmd[8025]: 2006/03/27_11:47:53 info: mask(fsa.c:do_state_transition): State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=do_msg_route ] crmd[8025]: 2006/03/27_11:47:53 info: mask(fsa.c:do_state_transition): All 1 cluster nodes are eligable to run resources. cib[8140]: 2006/03/27_11:47:53 info: mask(io.c:write_cib_contents): Writing version 0.90.33811 of the CIB to disk pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [generation] pengine[8030]: 2006/03/27_11:47:53 info: mask(unpack.c:unpack_config): Default stickiness: 0 pengine[8030]: 2006/03/27_11:47:53 WARN: mask(unpack.c:unpack_config): No value specified for cluster preference: stonith_enabled pengine[8030]: 2006/03/27_11:47:53 info: mask(unpack.c:unpack_config): STONITH of failed nodes is disabled pengine[8030]: 2006/03/27_11:47:53 info: mask(unpack.c:unpack_config): Cluster is symmetric - resources can run anywhere by default pengine[8030]: 2006/03/27_11:47:53 info: mask(unpack.c:unpack_config): Using short resource names: true pengine[8030]: 2006/03/27_11:47:53 info: mask(unpack.c:unpack_config): On loss of CCM Quorum: Stop ALL resources pengine[8030]: 2006/03/27_11:47:53 info: mask(unpack.c:unpack_config): Orphan resources are ignored pengine[8030]: 2006/03/27_11:47:53 info: mask(unpack.c:unpack_config): Orphan resource actions are stopped pengine[8030]: 2006/03/27_11:47:53 info: mask(unpack.c:unpack_config): Stopped resources are removed from the status section: false pengine[8030]: 2006/03/27_11:47:53 info: mask(unpack.c:unpack_config): By default resources are managed pengine[8030]: 2006/03/27_11:47:53 info: Resource Group: heartbeat_group_1 pengine[8030]: 2006/03/27_11:47:53 info: IPaddr_1 (heartbeat::ocf:IPaddr): node1 pengine[8030]: 2006/03/27_11:47:53 info: drbd_2 (heartbeat::heartbeat:datadisk): NOT ACTIVE pengine[8030]: 2006/03/27_11:47:53 info: Filesystem_3 (heartbeat::ocf:Filesystem): NOT ACTIVE pengine[8030]: 2006/03/27_11:47:53 info: smb_4 (heartbeat::heartbeat:smb): NOT ACTIVE pengine[8030]: 2006/03/27_11:47:53 info: nfsserver_5 (heartbeat::heartbeat:nfsserver): NOT ACTIVE pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:NoRoleChange): Leave resource IPaddr_1 (node1) pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:Recurring): node1 IPaddr_1_monitor_5000 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:StartRsc): node1 Start drbd_2 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:Recurring): node1 drbd_2_monitor_120000 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:StartRsc): node1 Start Filesystem_3 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:Recurring): node1 Filesystem_3_monitor_120000 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:StartRsc): node1 Start smb_4 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:Recurring): node1 smb_4_monitor_120000 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:StartRsc): node1 Start nfsserver_5 pengine[8030]: 2006/03/27_11:47:53 notice: mask(native.c:Recurring): node1 nfsserver_5_monitor_120000 pengine[8030]: 2006/03/27_11:47:53 info: mask(stages.c:stage8): Created transition graph 1. pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] pengine[8030]: 2006/03/27_11:47:53 info: mask(process_pe_message): [status] crmd[8025]: 2006/03/27_11:47:53 info: mask(fsa.c:do_state_transition): State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=do_msg_route ] tengine[8029]: 2006/03/27_11:47:53 info: mask(unpack.c:unpack_graph): Unpacked transition 1: 11 actions in 11 synapses tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:initiate_action): Executing pseudo-event: 12 tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:update_synapse_confirmed): Confirmed: Action 12 of Synapse 0 tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:initiate_action): Executing rsc-event: 3 tengine[8029]: 2006/03/27_11:47:53 info: mask(actions.c:send_rsc_command): Initiating action 3: IPaddr_1_monitor_5000 on node1 tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:initiate_action): Executing rsc-event: 4 tengine[8029]: 2006/03/27_11:47:53 info: mask(actions.c:send_rsc_command): Initiating action 4: drbd_2_start_0 on node1 crmd[8025]: 2006/03/27_11:47:53 info: mask(lrm.c:do_lrm_rsc_op): Performing op monitor on IPaddr_1 (interval=5000ms) crmd[8025]: 2006/03/27_11:47:53 info: mask(lrm.c:do_lrm_rsc_op): Performing op start on drbd_2 (interval=0ms) crmd[8025]: 2006/03/27_11:47:53 info: mask(lrm.c:do_lrm_event): LRM operation (9) start_0 on drbd_2 complete cib[8022]: 2006/03/27_11:47:53 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8022]: 2006/03/27_11:47:53 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:28): 0.90.33811 -> 0.90.33812 (ok) cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:53 info: mask(callbacks.c:te_update_diff): Processing diff (cib_update): 0.90.33811 -> 0.90.33812 tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:update_synapse_confirmed): Confirmed: Action 4 of Synapse 3 tengine[8029]: 2006/03/27_11:47:53 info: mask(events.c:match_graph_event): Action drbd_2_start_0 (4) confirmed tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:initiate_action): Executing rsc-event: 5 tengine[8029]: 2006/03/27_11:47:53 info: mask(actions.c:send_rsc_command): Initiating action 5: drbd_2_monitor_120000 on node1 cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:initiate_action): Executing rsc-event: 6 tengine[8029]: 2006/03/27_11:47:53 info: mask(actions.c:send_rsc_command): Initiating action 6: Filesystem_3_start_0 on node1 cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + crmd[8025]: 2006/03/27_11:47:53 info: mask(lrm.c:do_lrm_rsc_op): Performing op monitor on drbd_2 (interval=120000ms) cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + crmd[8025]: 2006/03/27_11:47:53 info: mask(lrm.c:do_lrm_rsc_op): Performing op start on Filesystem_3 (interval=0ms) cib[8164]: 2006/03/27_11:47:53 info: mask(io.c:write_cib_contents): Writing version 0.90.33812 of the CIB to disk crmd[8025]: 2006/03/27_11:47:53 info: mask(lrm.c:do_lrm_event): LRM operation (10) monitor_120000 on drbd_2 complete cib[8022]: 2006/03/27_11:47:53 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw crmd[8025]: 2006/03/27_11:47:53 info: mask(lrm.c:do_lrm_event): LRM operation (8) monitor_5000 on IPaddr_1 complete cib[8022]: 2006/03/27_11:47:53 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:29): 0.90.33812 -> 0.90.33813 (ok) cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:53 info: mask(callbacks.c:te_update_diff): Processing diff (cib_update): 0.90.33812 -> 0.90.33813 tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:update_synapse_confirmed): Confirmed: Action 5 of Synapse 4 tengine[8029]: 2006/03/27_11:47:53 info: mask(events.c:match_graph_event): Action drbd_2_monitor_120000 (5) confirmed cib[8022]: 2006/03/27_11:47:53 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8022]: 2006/03/27_11:47:53 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:30): 0.90.33813 -> 0.90.33814 (ok) cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:53 info: mask(callbacks.c:te_update_diff): Processing diff (cib_update): 0.90.33813 -> 0.90.33814 cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:53 info: mask(graph.c:update_synapse_confirmed): Confirmed: Action 3 of Synapse 2 cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:53 info: mask(events.c:match_graph_event): Action IPaddr_1_monitor_5000 (3) confirmed cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:53 info: mask(cib:diff): + cib[8185]: 2006/03/27_11:47:53 info: mask(io.c:write_cib_contents): Writing version 0.90.33814 of the CIB to disk crmd[8025]: 2006/03/27_11:47:54 info: mask(lrm.c:do_lrm_event): LRM operation (11) start_0 on Filesystem_3 complete cib[8022]: 2006/03/27_11:47:54 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8022]: 2006/03/27_11:47:54 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:31): 0.90.33814 -> 0.90.33815 (ok) cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:54 info: mask(callbacks.c:te_update_diff): Processing diff (cib_update): 0.90.33814 -> 0.90.33815 tengine[8029]: 2006/03/27_11:47:54 info: mask(graph.c:update_synapse_confirmed): Confirmed: Action 6 of Synapse 5 tengine[8029]: 2006/03/27_11:47:54 info: mask(events.c:match_graph_event): Action Filesystem_3_start_0 (6) confirmed tengine[8029]: 2006/03/27_11:47:54 info: mask(graph.c:initiate_action): Executing rsc-event: 7 tengine[8029]: 2006/03/27_11:47:54 info: mask(actions.c:send_rsc_command): Initiating action 7: Filesystem_3_monitor_120000 on node1 tengine[8029]: 2006/03/27_11:47:54 info: mask(graph.c:initiate_action): Executing rsc-event: 8 tengine[8029]: 2006/03/27_11:47:54 info: mask(actions.c:send_rsc_command): Initiating action 8: smb_4_start_0 on node1 cib[8191]: 2006/03/27_11:47:54 info: mask(io.c:write_cib_contents): Writing version 0.90.33815 of the CIB to disk crmd[8025]: 2006/03/27_11:47:54 info: mask(lrm.c:do_lrm_rsc_op): Performing op monitor on Filesystem_3 (interval=120000ms) crmd[8025]: 2006/03/27_11:47:54 info: mask(lrm.c:do_lrm_rsc_op): Performing op start on smb_4 (interval=0ms) lrmd[8024]: 2006/03/27_11:47:54 info: RA output: (smb_4:start:stdout) Starting Samba SMB daemon crmd[8025]: 2006/03/27_11:47:54 info: mask(lrm.c:do_lrm_event): LRM operation (12) monitor_120000 on Filesystem_3 complete cib[8022]: 2006/03/27_11:47:54 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8022]: 2006/03/27_11:47:54 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:32): 0.90.33815 -> 0.90.33816 (ok) cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:54 info: mask(callbacks.c:te_update_diff): Processing diff (cib_update): 0.90.33815 -> 0.90.33816 tengine[8029]: 2006/03/27_11:47:54 info: mask(graph.c:update_synapse_confirmed): Confirmed: Action 7 of Synapse 6 tengine[8029]: 2006/03/27_11:47:54 info: mask(events.c:match_graph_event): Action Filesystem_3_monitor_120000 (7) confirmed cib[8203]: 2006/03/27_11:47:54 info: mask(io.c:write_cib_contents): Writing version 0.90.33816 of the CIB to disk lrmd[8024]: 2006/03/27_11:47:54 info: RA output: (smb_4:start:stdout) ..done crmd[8025]: 2006/03/27_11:47:54 info: mask(lrm.c:do_lrm_event): LRM operation (13) start_0 on smb_4 complete cib[8022]: 2006/03/27_11:47:54 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8022]: 2006/03/27_11:47:54 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:33): 0.90.33816 -> 0.90.33817 (ok) cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:54 info: mask(callbacks.c:te_update_diff): Processing diff (cib_update): 0.90.33816 -> 0.90.33817 cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:54 info: mask(graph.c:update_synapse_confirmed): Confirmed: Action 8 of Synapse 7 cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:54 info: mask(events.c:match_graph_event): Action smb_4_start_0 (8) confirmed cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:54 info: mask(graph.c:initiate_action): Executing rsc-event: 9 tengine[8029]: 2006/03/27_11:47:54 info: mask(actions.c:send_rsc_command): Initiating action 9: smb_4_monitor_120000 on node1 cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:54 info: mask(graph.c:initiate_action): Executing rsc-event: 10 tengine[8029]: 2006/03/27_11:47:54 info: mask(actions.c:send_rsc_command): Initiating action 10: nfsserver_5_start_0 on node1 crmd[8025]: 2006/03/27_11:47:54 info: mask(lrm.c:do_lrm_rsc_op): Performing op monitor on smb_4 (interval=120000ms) cib[8207]: 2006/03/27_11:47:54 info: mask(io.c:write_cib_contents): Writing version 0.90.33817 of the CIB to disk crmd[8025]: 2006/03/27_11:47:54 info: mask(lrm.c:do_lrm_rsc_op): Performing op start on nfsserver_5 (interval=0ms) lrmd[8024]: 2006/03/27_11:47:54 info: RA output: (nfsserver_5:start:stdout) Starting kernel based NFS server crmd[8025]: 2006/03/27_11:47:54 info: mask(lrm.c:do_lrm_event): LRM operation (14) monitor_120000 on smb_4 complete cib[8022]: 2006/03/27_11:47:54 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8022]: 2006/03/27_11:47:54 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:34): 0.90.33817 -> 0.90.33818 (ok) cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:54 info: mask(callbacks.c:te_update_diff): Processing diff (cib_update): 0.90.33817 -> 0.90.33818 tengine[8029]: 2006/03/27_11:47:54 info: mask(graph.c:update_synapse_confirmed): Confirmed: Action 9 of Synapse 8 tengine[8029]: 2006/03/27_11:47:54 info: mask(events.c:match_graph_event): Action smb_4_monitor_120000 (9) confirmed cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8222]: 2006/03/27_11:47:54 info: mask(io.c:write_cib_contents): Writing version 0.90.33818 of the CIB to disk lrmd[8024]: 2006/03/27_11:47:54 info: RA output: (nfsserver_5:start:stdout) ..done crmd[8025]: 2006/03/27_11:47:54 info: mask(lrm.c:do_lrm_event): LRM operation (15) start_0 on nfsserver_5 complete cib[8022]: 2006/03/27_11:47:54 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8022]: 2006/03/27_11:47:54 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:35): 0.90.33818 -> 0.90.33819 (ok) cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:54 info: mask(callbacks.c:te_update_diff): Processing diff (cib_update): 0.90.33818 -> 0.90.33819 tengine[8029]: 2006/03/27_11:47:54 info: mask(graph.c:update_synapse_confirmed): Confirmed: Action 10 of Synapse 9 tengine[8029]: 2006/03/27_11:47:54 info: mask(events.c:match_graph_event): Action nfsserver_5_start_0 (10) confirmed tengine[8029]: 2006/03/27_11:47:54 info: mask(graph.c:initiate_action): Executing pseudo-event: 13 tengine[8029]: 2006/03/27_11:47:54 info: mask(graph.c:update_synapse_confirmed): Confirmed: Action 13 of Synapse 1 tengine[8029]: 2006/03/27_11:47:54 info: mask(graph.c:initiate_action): Executing rsc-event: 11 tengine[8029]: 2006/03/27_11:47:54 info: mask(actions.c:send_rsc_command): Initiating action 11: nfsserver_5_monitor_120000 on node1 cib[8225]: 2006/03/27_11:47:54 info: mask(io.c:write_cib_contents): Writing version 0.90.33819 of the CIB to disk crmd[8025]: 2006/03/27_11:47:54 info: mask(lrm.c:do_lrm_rsc_op): Performing op monitor on nfsserver_5 (interval=120000ms) crmd[8025]: 2006/03/27_11:47:54 info: mask(lrm.c:do_lrm_event): LRM operation (16) monitor_120000 on nfsserver_5 complete cib[8022]: 2006/03/27_11:47:54 info: mask(callbacks.c:cib_common_callback_worker): Processing cib_update operation from 8025/cib_rw cib[8022]: 2006/03/27_11:47:54 info: mask(notify.c:cib_diff_notify): Update (client: 8025, call:36): 0.90.33819 -> 0.90.33820 (ok) cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): - cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + cib[8022]: 2006/03/27_11:47:54 info: mask(cib:diff): + tengine[8029]: 2006/03/27_11:47:54 info: mask(callbacks.c:te_update_diff): Processing diff (cib_update): 0.90.33819 -> 0.90.33820 cib[8230]: 2006/03/27_11:47:54 info: mask(io.c:write_cib_contents): Writing version 0.90.33820 of the CIB to disk tengine[8029]: 2006/03/27_11:47:54 info: mask(graph.c:update_synapse_confirmed): Confirmed: Action 11 of Synapse 10 tengine[8029]: 2006/03/27_11:47:54 info: mask(events.c:match_graph_event): Action nfsserver_5_monitor_120000 (11) confirmed tengine[8029]: 2006/03/27_11:47:54 info: mask(graph.c:run_graph): Transition 1 Complete: 11, Pending: 0, Fired: 0, Skipped: 0, Incomplete: 0 tengine[8029]: 2006/03/27_11:47:54 info: mask(actions.c:notify_crmd): Transition 1 status: te_complete - (null) tengine[8029]: 2006/03/27_11:47:54 info: mask(utils.c:print_graph): Synapse 0 was confirmed (priority: 0) tengine[8029]: 2006/03/27_11:47:54 info: mask(utils.c:print_graph): Synapse 1 was confirmed (priority: 0) tengine[8029]: 2006/03/27_11:47:54 info: mask(utils.c:print_graph): Synapse 2 was confirmed (priority: 0) tengine[8029]: 2006/03/27_11:47:54 info: mask(utils.c:print_graph): Synapse 3 was confirmed (priority: 0) tengine[8029]: 2006/03/27_11:47:54 info: mask(utils.c:print_graph): Synapse 4 was confirmed (priority: 0) tengine[8029]: 2006/03/27_11:47:54 info: mask(utils.c:print_graph): Synapse 5 was confirmed (priority: 0) tengine[8029]: 2006/03/27_11:47:54 info: mask(utils.c:print_graph): Synapse 6 was confirmed (priority: 0) tengine[8029]: 2006/03/27_11:47:54 info: mask(utils.c:print_graph): Synapse 7 was confirmed (priority: 0) tengine[8029]: 2006/03/27_11:47:54 info: mask(utils.c:print_graph): Synapse 8 was confirmed (priority: 0) tengine[8029]: 2006/03/27_11:47:54 info: mask(utils.c:print_graph): Synapse 9 was confirmed (priority: 0) tengine[8029]: 2006/03/27_11:47:54 info: mask(utils.c:print_graph): Synapse 10 was confirmed (priority: 0) crmd[8025]: 2006/03/27_11:47:54 info: mask(fsa.c:do_state_transition): State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=do_msg_route ]