We are trying to get the storage nodes connected in the cluster with 2 VMs, 1 instance on each VM. We end up seeing 1 up in Normal status, the other in Down. Here is the error in the logs:
10:59:19,324 ERROR [org.rhq.server.metrics.MetricsServer] (StorageClientThreadPool-0) An error occurred while inserting raw data Measuremen tDataNumeric[name=Native.MemoryInfo.actualFree, value=1.2627976192E10, scheduleId=11495, timestamp=1403017146580]: com.datastax.driver.core .exceptions.UnavailableException: Not enough replica available for query at consistency ONE (1 required but only 0 alive)
What is the reported availability for each node?
On Jun 17, 2014, at 11:06 AM, barry.barnett@wellsfargo.com wrote:
We are trying to get the storage nodes connected in the cluster with 2 VMs, 1 instance on each VM. We end up seeing 1 up in Normal status, the other in Down. Here is the error in the logs:
Are you referring to the cluster status column? If that reports down that suggests a cluster maintenance task failed. Can you do the following for each storage node,
cd <RHQ_SERVER_HOME>/rhq-storage/bin ./nodetool -p 7299 status
What is the output? I am wondering if you may have run into a problem deploying the second node such that the might not be clustered properly.
10:59:19,324 ERROR [org.rhq.server.metrics.MetricsServer] (StorageClientThreadPool-0) An error occurred while inserting raw data Measuremen tDataNumeric[name=Native.MemoryInfo.actualFree, value=1.2627976192E10, scheduleId=11495, timestamp=1403017146580]: com.datastax.driver.core .exceptions.UnavailableException: Not enough replica available for query at consistency ONE (1 required but only 0 alive)
rhq-users mailing list rhq-users@lists.fedorahosted.org https://lists.fedorahosted.org/mailman/listinfo/rhq-users
Both nodes show running.
From: rhq-users-bounces@lists.fedorahosted.org [mailto:rhq-users-bounces@lists.fedorahosted.org] On Behalf Of John Sanda Sent: Tuesday, June 17, 2014 12:38 PM To: rhq-users@lists.fedorahosted.org Subject: Re: RHQ storage node issue in cluster - Down state
What is the reported availability for each node?
On Jun 17, 2014, at 11:06 AM, barry.barnett@wellsfargo.commailto:barry.barnett@wellsfargo.com wrote:
We are trying to get the storage nodes connected in the cluster with 2 VMs, 1 instance on each VM. We end up seeing 1 up in Normal status, the other in Down. Here is the error in the logs:
Are you referring to the cluster status column? If that reports down that suggests a cluster maintenance task failed. Can you do the following for each storage node,
cd <RHQ_SERVER_HOME>/rhq-storage/bin ./nodetool -p 7299 status
What is the output? I am wondering if you may have run into a problem deploying the second node such that the might not be clustered properly.
10:59:19,324 ERROR [org.rhq.server.metrics.MetricsServer] (StorageClientThreadPool-0) An error occurred while inserting raw data Measuremen tDataNumeric[name=Native.MemoryInfo.actualFree, value=1.2627976192E10, scheduleId=11495, timestamp=1403017146580]: com.datastax.driver.core .exceptions.UnavailableException: Not enough replica available for query at consistency ONE (1 required but only 0 alive)
_______________________________________________ rhq-users mailing list rhq-users@lists.fedorahosted.orgmailto:rhq-users@lists.fedorahosted.org https://lists.fedorahosted.org/mailman/listinfo/rhq-users
Can you share the output? The status command reports other information. The output looks something like,
./nodetool -p 7299 status Datacenter: datacenter1 ======================= Status=Up/Down |/ State=Normal/Leaving/Joining/Moving -- Address Load Tokens Owns (effective) Host ID Rack DN 127.0.0.1 ? 256 62.9% 70a56cac-24f1-4727-8845-9e2e3ae066cc rack1 UN 127.0.0.2 19.68 MB 256 68.8% 770d9245-04dd-4569-83a9-93311b4d558c rack1 UN 127.0.0.3 17.7 MB 256 68.3% b1e967e7-0cbc-4ac4-b44f-a88a8a31ce11 rack1
On Jun 17, 2014, at 12:43 PM, barry.barnett@wellsfargo.com wrote:
Both nodes show running.
From: rhq-users-bounces@lists.fedorahosted.org [mailto:rhq-users-bounces@lists.fedorahosted.org] On Behalf Of John Sanda Sent: Tuesday, June 17, 2014 12:38 PM To: rhq-users@lists.fedorahosted.org Subject: Re: RHQ storage node issue in cluster - Down state
What is the reported availability for each node?
On Jun 17, 2014, at 11:06 AM, barry.barnett@wellsfargo.com wrote:
We are trying to get the storage nodes connected in the cluster with 2 VMs, 1 instance on each VM. We end up seeing 1 up in Normal status, the other in Down. Here is the error in the logs:
Are you referring to the cluster status column? If that reports down that suggests a cluster maintenance task failed. Can you do the following for each storage node,
cd <RHQ_SERVER_HOME>/rhq-storage/bin ./nodetool -p 7299 status
What is the output? I am wondering if you may have run into a problem deploying the second node such that the might not be clustered properly.
10:59:19,324 ERROR [org.rhq.server.metrics.MetricsServer] (StorageClientThreadPool-0) An error occurred while inserting raw data Measuremen tDataNumeric[name=Native.MemoryInfo.actualFree, value=1.2627976192E10, scheduleId=11495, timestamp=1403017146580]: com.datastax.driver.core .exceptions.UnavailableException: Not enough replica available for query at consistency ONE (1 required but only 0 alive)
rhq-users mailing list rhq-users@lists.fedorahosted.org https://lists.fedorahosted.org/mailman/listinfo/rhq-users
rhq-users mailing list rhq-users@lists.fedorahosted.org https://lists.fedorahosted.org/mailman/listinfo/rhq-users
rhq-users@lists.stg.fedorahosted.org
-
barry.barnett＠wellsfargo.com -
John Sanda