hi
I am trying the cloud setup in managed mode
After a great struggle I made the network configuration work for the managed mode.
But now when i try euca-run-instance ,the instance starts goes to the pending state and then terminates
When i checked in the nc.log it gives the following error as
[EUCAERROR ] walrus_request(): server responded with HTTP code 403
I tried all the results in the forum
I checked for the credentials (cloud-cert.pem) and downloaded again a new debian image from the eucalyptus repository and bundled,registered the image,but still the same error persists
I will attach the log files below
FrontEnd eth0 -192.168.61.1 (registered for Walrus,sc,cluster)
eth1 -172.16.1.1 (private ununsed network)
Nodes eth0 -172.16.1.2
FE eucalyptus.conf:
VNET_PUBINTERFACE="eth0"
VNET_PRIVINTERFACE="eth1"
VNET_DHCPDAEMON="/usr/sbin/dhcpd3"
VNET_DHCPUSER="root"
VNET_MODE="MANAGED"
VNET_SUBNET="172.16.0.0"
VNET_NETMASK="255.255.0.0"
VNET_DNS="192.168.31.30"
VNET_ADDRSPERNET="64"
VNET_PUBLICIPS="192.168.61.100-192.168.61.200"
Node Eucalyptus.conf
VNET_PUBINTERFACE="eth0"
VNET_PRIVINTERFACE="eth0"
VNET_MODE="MANAGED"
# euca-run-instance
root@chncloud3[~]#euca-run-instances -k key emi-BEAF0FF8
RESERVATION r-3ECF07FB admin admin-default
INSTANCE i-3B8E0769 emi-BEAF0FF8 0.0.0.0 0.0.0.0 pending key 2010-09-07T11:55:52.612Z eki-3883120A eri-70FE12F1
#euca-describe-instance
root@chncloud3[~]#euca-describe-instances
RESERVATION r-3ECF07FB admin default
INSTANCE i-3B8E0769 emi-BEAF0FF8 192.168.61.102 172.16.2.2 terminated key 0 m1.small 2010-09-07T11:55:52.612Z cloud eki-3883120A eri-70FE12F1
cc.log:
[EUCADEBUG ] DescribeNetworks(): params: userId=eucalyptus, nameserver=172.16.1.1, ccsLen=1
[EUCADEBUG ] vnetSetCCS(): input CC=192.168.61.1
[EUCADEBUG ] vnetSetCCS(): setting localIpId: 0
][EUCAINFO ] DescribeResources(): called
[[EUCAINFO ] DescribeInstances(): called
[[EUCADEBUG ] DescribeResources(): params: userId=eucalyptus, vmLen=5
[EUCAINFO ] DescribePublicAddresses(): called
][EUCADEBUG ] DescribeInstances(): params: userId=eucalyptus, instIdsLen=0
[[EUCADEBUG ] DescribePublicAddresses(): params: userId=eucalyptus
[[EUCADEBUG ] DescribePublicAddresses(): done
][EUCAINFO ] DescribeResources(): resources 8/8 8/8 8/8 4/4 3/3
[[EUCADEBUG ] DescribeResources(): done
[[EUCADEBUG ] DescribeInstances(): returning: instanceId=i-3B8E0769, state=Teardown, publicIp=0.0.0.0, privateIp=172.16.2.2, volumesSize=0
[EUCADEBUG ] DescribeInstances(): done
[][EUCADEBUG ] DescribeNetworks(): done
][EUCADEBUG ] monitor_thread(): running
][EUCAINFO ] refresh_resources(): called
[][EUCADEBUG ] refresh_resources(): calling http://172.16.1.2:8775/axis2/services/EucalyptusNC
[EUCADEBUG ] refresh_resources(): time left for next op: 60
][EUCADEBUG ] refresh_resources(): node=172.16.1.2 mem=15131/15131 disk=3546/3546 cores=8/8
][EUCADEBUG ] refresh_resources(): done
[][EUCAINFO ] refresh_instances(): called
[][EUCADEBUG ] refresh_instances(): timeout(60/60) len
][EUCADEBUG ] refresh_instances(): node 172.16.1.2 idle since 1283860640: (18/300) seconds
[EUCADEBUG ] refresh_instances(): done
[[EUCADEBUG ] monitor_thread(): done
cloud-debug.log:
at java.lang.Thread.run(Thread.java:636)
17:30:10 INFO [AbstractClusterMessageDispatcher:New I/O client worker #2-34] :1283860810162:GetKeysType:uid:eucalyptus:eucalyptus:MSG_SENT:[GetKeysType serviceTag=self correlationId=f1adf009-ec29-429b-ac6f-cf6b4f6a43ec userId=null effectiveUserId=null _return=false statusMessage=null]:
17:30:10 INFO [AbstractClusterMessageDispatcher:New I/O client worker #2-35] :1283860810163:DescribeNetworksType:uid:eucalyptus:eucalyptus:MSG_SENT:[DescribeNetworksType nameserver=172.16.1.1 clusterControllers=[192.168.61.1] correlationId=4e81b9c3-80dd-4943-af9a-35ffbd1d285f userId=eucalyptus effectiveUserId=eucalyptus _return=false statusMessage=null]:
17:30:10 INFO [ClusterUtil:New I/O client worker #2-34] ---------------------------------------------------------------
17:30:10 INFO [AbstractClusterMessageDispatcher:New I/O client worker #2-38] :1283860810180:DescribePublicAddressesType:uid:eucalyptus:eucalyptus:MSG_SENT:[DescribePublicAddressesType correlationId=82740aac-fa9e-461e-a8af-79b912e758de userId=eucalyptus effectiveUserId=eucalyptus _return=false statusMessage=null]:
17:30:10 INFO [AbstractClusterMessageDispatcher:New I/O client worker #2-36] :1283860810167:DescribeResourcesType:uid:eucalyptus:eucalyptus:MSG_SENT:[DescribeResourcesType instanceTypes=[VmTypeInfo{name='m1.small', memory=128, disk=10, cores=1}, VmTypeInfo{name='c1.medium', memory=256, disk=10, cores=1}, VmTypeInfo{name='m1.large', memory=512, disk=10, cores=1}, VmTypeInfo{name='m1.xlarge', memory=1024, disk=20, cores=2}, VmTypeInfo{name='c1.xlarge', memory=4096, disk=40, cores=2}] correlationId=917859d8-b06d-431e-8b4e-75ede315b6bf userId=eucalyptus effectiveUserId=eucalyptus _return=false statusMessage=null]:
17:30:10 INFO [AbstractClusterMessageDispatcher:New I/O client worker #2-37] :1283860810166:VmDescribeType:uid:eucalyptus:eucalyptus:MSG_SENT:[VmDescribeType instancesSet=[] correlationId=bb754066-3b67-4764-b48e-0b6642657b27 userId=eucalyptus effectiveUserId=eucalyptus _return=false statusMessage=null]:
17:30:10 INFO [ClusterUtil:New I/O client worker #2-34] -> [ cloud ] Cluster certificate valid=true
17:30:10 INFO [ClusterUtil:New I/O client worker #2-34] -> [ cloud ] Node certificate valid=true
17:30:10 INFO [ClusterUtil:New I/O client worker #2-34] ---------------------------------------------------------------
17:30:10 INFO [AbstractClusterMessageDispatcher:New I/O client worker #2-38] :1283860810332:DescribePublicAddressesResponseType:uid:eucalyptus:eucalyptus:MSG_SENT:[DescribePublicAddressesResponseType addresses=[192.168.61.100, 192.168.61.101, 192.168.61.102, 192.168.61.103, 192.168.61.104, 192.168.61.105, 192.168.61.106, 192.168.61.107, 192.168.61.108, 192.168.61.109, 192.168.61.110, 192.168.61.111, 192.168.61.112, 192.168.61.113, 192.168.61.114, 192.168.61.115, 192.168.61.116, 192.168.61.117, 192.168.61.118, 192.168.61.119, 192.168.61.120, 192.168.61.121, 192.168.61.122, 192.168.61.123, 192.168.61.124, 192.168.61.125, 192.168.61.126, 192.168.61.127, 192.168.61.128, 192.168.61.129, 192.168.61.130, 192.168.61.131, 192.168.61.132, 192.168.61.133, 192.168.61.134, 192.168.61.135, 192.168.61.136, 192.168.61.137, 192.168.61.138, 192.168.61.139, 192.168.61.140, 192.168.61.141, 192.168.61.142, 192.168.61.143, 192.168.61.144, 192.168.61.145, 192.168.61.146, 192.168.61.147, 192.168.61.148, 192.168.61.149, 192.168.61.150, 192.168.61.151, 192.168.61.152, 192.168.61.153, 192.168.61.154, 192.168.61.155, 192.168.61.156, 192.168.61.157, 192.168.61.158, 192.168.61.159, 192.168.61.160, 192.168.61.161, 192.168.61.162, 192.168.61.163, 192.168.61.164, 192.168.61.165, 192.168.61.166, 192.168.61.167, 192.168.61.168, 192.168.61.169, 192.168.61.170, 192.168.61.171, 192.168.61.172, 192.168.61.173, 192.168.61.174, 192.168.61.175, 192.168.61.176, 192.168.61.177, 192.168.61.178, 192.168.61.179, 192.168.61.180, 192.168.61.181, 192.168.61.182, 192.168.61.183, 192.168.61.184, 192.168.61.185, 192.168.61.186, 192.168.61.187, 192.168.61.188, 192.168.61.189, 192.168.61.190, 192.168.61.191, 192.168.61.192, 192.168.61.193, 192.168.61.194, 192.168.61.195, 192.168.61.196, 192.168.61.197, 192.168.61.198, 192.168.61.199, 192.168.61.200] mapping=[, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] correlationId=82740aac-fa9e-461e-a8af-79b912e758de userId=eucalyptus effectiveUserId=null _return=true statusMessage=null]:
17:30:10 DEBUG [Address:New I/O client worker #2-38] :1283860810333:Address:uid:eucalyptus:eucalyptus:allocated:[Address id=115 name=192.168.61.101 cluster=cloud userId=nobody instanceId=available instanceAddress=0.0.0.0 state=AtomicMarkableReference QUIESCENT= transition=[SplitTransition previous=allocated, transition=allocating, next=allocated, pending=true]]:
17:30:10 DEBUG [AbstractSystemAddressManager:New I/O client worker #2-38] java.lang.IllegalStateException: Cannot mark address as allocating[unallocated.false->allocated.true] when it is allocated.true: [Address id=115 name=192.168.61.101 cluster=cloud userId=nobody instanceId=available instanceAddress=0.0.0.0 state=AtomicMarkableReference QUIESCENT= transition=[SplitTransition previous=allocated, transition=allocating, next=allocated, pending=true]]
java.lang.IllegalStateException: Cannot mark address as allocating[unallocated.false->allocated.true] when it is allocated.true: [Address id=115 name=192.168.61.101 cluster=cloud userId=nobody instanceId=available instanceAddress=0.0.0.0 state=AtomicMarkableReference QUIESCENT= transition=[SplitTransition previous=allocated, transition=allocating, next=allocated, pending=true]]
cloud-error.log:
17:34:52 [UnassignAddressCallback:New I/O client worker #2-18] ERROR java.lang.IllegalStateException: Trying to clear an address which is not currently pending.
java.lang.IllegalStateException: Trying to clear an address which is not currently pending.
at com.eucalyptus.address.Address.clearPending(Address.java:341)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite$PojoCachedMethodSiteNoUnwrapNoCoerce.invoke(PojoMetaMethodSite.java:229)
at org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite.call(PojoMetaMethodSite.java:52)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCall
cloud-output.log:
17:38:03 INFO ClusterUtil | ClusterUtil.java:37 ---------------------------------------------------------------
17:38:03 INFO ClusterUtil | ClusterUtil.java:42 -> [ cloud ] Cluster certificate valid=true
17:38:03 INFO ClusterUtil | ClusterUtil.java:47 -> [ cloud ] Node certificate valid=true
17:38:03 INFO ClusterUtil | ClusterUtil.java:48 ---------------------------------------------------------------
17:38:03 INFO tClusterMessageDispatcher | AbstractClusterMessageDispatcher.java:134 :1283861283121:DescribeResourcesType:uid:eucalyptus:eucalyptus:MSG_SENT:[DescribeResourcesType instanceTypes=[VmTypeInfo{name='m1.small', memory=128, disk=10, cores=1}, VmTypeInfo{name='c1.medium', memory=256, disk=10, cores=1}, VmTypeInfo{name='m1.large', memory=512, disk=10, cores=1}, VmTypeInfo{name='m1.xlarge', memory=1024, disk=20, cores=2}, VmTypeInfo{name='c1.xlarge', memory=4096, disk=40, cores=2}] correlationId=05490b75-0e9f-4e92-a30f-52ac9b425fbb userId=eucalyptus effectiveUserId=eucalyptus _return=false statusMessage=null]:
17:38:03 INFO tClusterMessageDispatcher | AbstractClusterMessageDispatcher.java:134 :1283861283121:VmDescribeType:uid:eucalyptus:eucalyptus:MSG_SENT:[VmDescribeType instancesSet=[] correlationId=fc96cf1f-d254-47e9-8ae0-78eb23864ad0 userId=eucalyptus effectiveUserId=eucalyptus _return=false statusMessage=null]:
17:38:03 INFO tClusterMessageDispatcher | AbstractClusterMessageDispatcher.java:134 :1283861283123:DescribePublicAddressesType:uid:eucalyptus:eucalyptus:MSG_SENT:[DescribePublicAddressesType correlationId=989fbd2f-6705-4399-972d-cc9773dabb4a userId=eucalyptus effectiveUserId=eucalyptus _return=false statusMessage=null]:
17:38:03 INFO tClusterMessageDispatcher | AbstractClusterMessageDispatcher.java:175 :1283861283148:DescribePublicAddressesResponseType:uid:eucalyptus:eucalyptus:MSG_SENT:[DescribePublicAddressesResponseType addresses=[192.168.61.100, 192.168.61.101, 192.168.61.102, 192.168.61.103, 192.168.61.104, 192.168.61.105, 192.168.61.106, 192.168.61.107, 192.168.61.108, 192.168.61.109, 192.168.61.110, 192.168.61.111, 192.168.61.112, 192.168.61.113, 192.168.61.114, 192.168.61.115, 192.168.61.116, 192.168.61.117, 192.168.61.118, 192.168.61.119, 192.168.61.120, 192.168.61.121, 192.168.61.122, 192.168.61.123, 192.168.61.124, 192.168.61.125, 192.168.61.126, 192.168.61.127, 192.168.61.128, 192.168.61.129, 192.168.61.130, 192.168.61.131, 192.168.61.132, 192.168.61.133, 192.168.61.134, 192.168.61.135, 192.168.61.136, 192.168.61.137, 192.168.61.138, 192.168.61.139, 192.168.61.140, 192.168.61.141, 192.168.61.142, 192.168.61.143, 192.168.61.144, 192.168.61.145, 192.168.61.146, 192.168.61.147, 192.168.61.148, 192.168.61.149, 192.168.61.150, 192.168.61.151, 192.168.61.152, 192.168.61.153, 192.168.61.154, 192.168.61.155, 192.168.61.156, 192.168.61.157, 192.168.61.158, 192.168.61.159, 192.168.61.160, 192.168.61.161, 192.168.61.162, 192.168.61.163, 192.168.61.164, 192.168.61.165, 192.168.61.166, 192.168.61.167, 192.168.61.168, 192.168.61.169, 192.168.61.170, 192.168.61.171, 192.168.61.172, 192.168.61.173, 192.168.61.174, 192.168.61.175, 192.168.61.176, 192.168.61.177, 192.168.61.178, 192.168.61.179, 192.168.61.180, 192.168.61.181, 192.168.61.182, 192.168.61.183, 192.168.61.184, 192.168.61.185, 192.168.61.186, 192.168.61.187, 192.168.61.188, 192.168.61.189, 192.168.61.190, 192.168.61.191, 192.168.61.192, 192.168.61.193, 192.168.61.194, 192.168.61.195, 192.168.61.196, 192.168.61.197, 192.168.61.198, 192.168.61.199, 192.168.61.200] mapping=[, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] correlationId=989fbd2f-6705-4399-972d-cc9773dabb4a userId=eucalyptus effectiveUserId=null _return=true statusMessage=null]:
17:38:03 INFO tClusterMessageDispatcher | AbstractClusterMessageDispatcher.java:175 :1283861283184:VmDescribeResponseType:uid:eucalyptus:eucalyptus:MSG_SENT:[VmDescribeResponseType originCluster=null vms=[VmInfo [groupNames=[default], imageId=emi-BEAF0FF8, instanceId=i-45A10836, instanceType=VmTypeInfo{name='', memory=128, disk=10, cores=1}, kernelId=eki-3883120A, keyValue=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCQEU29lay/yv44WAj9O8oYX2ZLRLks2JNLbOD/l/sM+BiSbJ1YhytZDYugPKMTtlxlVMn8+STAw8hgOW7gtX5g5EFITiEUSa8+eZ0dadwHBMiruy2EoNKW/NPjgHx7dGi4QY++Q1w/ld+A7koLtIcAZ/4rjZiTQ8JEYFi3FmC7G4QML/VVxusqewRwlD6LpOblNXoVDEgWAiMp8WtiDJX4YCVA09enHoY4ZA8+Qq7zphYyy66uoqJPz+tO/ki3GH50e5lL3YRJKYx8DPn+IRZ6a6DM9Zq7RUCnANmDC+mjsIEm2eCL23XOQpaug9PXoQOkbzOCX+DdEO4wETtke0K9 admin@eucalyptus, launchIndex=0, launchTime=Tue Sep 07 17:34:36 IST 2010, netParams=NetworkConfigType{macAddress='d0:0d:45:A1:08:36', ipAddress='172.16.2.2', publicIp='0.0.0.0', privateDnsName='null', publicDnsName='null', vlan=10}, networkIndex=-1, ownerId=admin, placement=null, productCodes=[], ramdiskId=eri-70FE12F1, reservationId=r-3E4406DD, serviceTag=http://172.16.1.2:8775/axis2/services/EucalyptusNC, stateName=Teardown, userData=, volumes=[]], VmInfo [groupNames=[default], imageId=emi-BEAF0FF8, instanceId=i-3C270757, instanceType=VmTypeInfo{name='', memory=128, disk=10, cores=1}, kernelId=eki-3883120A, keyValue=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCQEU29lay/yv44WAj9O8oYX2ZLRLks2JNLbOD/l/sM+BiSbJ1YhytZDYugPKMTtlxlVMn8+STAw8hgOW7gtX5g5EFITiEUSa8+eZ0dadwHBMiruy2EoNKW/NPjgHx7dGi4QY++Q1w/ld+A7koLtIcAZ/4rjZiTQ8JEYFi3FmC7G4QML/VVxusqewRwlD6LpOblNXoVDEgWAiMp8WtiDJX4YCVA09enHoY4ZA8+Qq7zphYyy66uoqJPz+tO/ki3GH50e5lL3YRJKYx8DPn+IRZ6a6DM9Zq7RUCnANmDC+mjsIEm2eCL23XOQpaug9PXoQOkbzOCX+DdEO4wETtke0K9 admin@eucalyptus, launchIndex=0, launchTime=Tue Sep 07 17:34:48 IST 2010, netParams=NetworkConfigType{macAddress='d0:0d:3C:27:07:57', ipAddress='172.16.2.3', publicIp='0.0.0.0', privateDnsName='null', publicDnsName='null', vlan=10}, networkIndex=-1, ownerId=admin, placement=null, productCodes=[], ramdiskId=eri-70FE12F1, reservationId=r-4C3B0856, serviceTag=http://172.16.1.2:8775/axis2/services/EucalyptusNC, stateName=Teardown, userData=, volumes=[]]] correlationId=fc96cf1f-d254-47e9-8ae0-78eb23864ad0 userId=eucalyptus effectiveUserId=null _return=true statusMessage=null]:
Nc.log:
StartNetwork(): SUCCESS return from vnetStartNetwork 0
[Tue Sep 7 17:35:07 2010][012277][EUCAINFO ] StartNetwork(): done
[Tue Sep 7 17:35:07 2010][012277][EUCAINFO ] doRunInstance() invoked (id=i-3C270757 cores=1 disk=10 memory=128)
[Tue Sep 7 17:35:07 2010][012277][EUCAINFO ] image=emi-BEAF0FF8 at http://192.168.61.1:8773/services/Walrus/debnew/debian.5-0.x86.img.manif...
[Tue Sep 7 17:35:07 2010][012277][EUCAINFO ] krnel=eki-3883120A at http://192.168.61.1:8773/services/Walrus/debkernew/vmlinuz-2.6.24-19-xen...
[Tue Sep 7 17:35:07 2010][012277][EUCAINFO ] rmdsk=eri-70FE12F1 at http://192.168.61.1:8773/services/Walrus/debramnew/initrd.img-2.6.24-19-...
[Tue Sep 7 17:35:07 2010][012277][EUCAINFO ] vlan=10 priMAC=d0:0d:3C:27:07:57 pubMAC=d0:0d:3C:27:07:57
[Tue Sep 7 17:35:07 2010][012277][EUCAINFO ] network started for instance i-3C270757
[Tue Sep 7 17:35:07 2010][012277][EUCAINFO ] retrieving images for instance i-3C270757 (disk limit=10240MB)...
[Tue Sep 7 17:35:07 2010][012277][EUCAINFO ] walrus_request(): downloading /usr/local/eucalyptus/admin/i-3C270757/kernel-digest
[Tue Sep 7 17:35:07 2010][012277][EUCAINFO ] from http://192.168.61.1:8773/services/Walrus/debkernew/vmlinuz-2.6.24-19-xen...
[Tue Sep 7 17:35:07 2010][012277][EUCADEBUG ] walrus_request(): writing GET output to /usr/local/eucalyptus/admin/i-3C270757/kernel-digest
[Tue Sep 7 17:35:07 2010][012277][EUCADEBUG ] walrus_request(): wrote 1179 bytes in 0 writes
[Tue Sep 7 17:35:07 2010][012277][EUCAERROR ] walrus_request(): server responded with HTTP code 403
[Tue Sep 7 17:35:07 2010][012277][EUCAINFO ] walrus_request(): due to error, removing /usr/local/eucalyptus/admin/i-3C270757/kernel-digest
[Tue Sep 7 17:35:07 2010][012277][EUCAERROR ] error: failed to obtain digest from http://192.168.61.1:8773/services/Walrus/debkernew/vmlinuz-2.6.24-19-xen...
[Tue Sep 7 17:35:07 2010][012277][EUCAERROR ] get_cached_file() failed (errno=1)
[Tue Sep 7 17:35:07 2010][012277][EUCAFATAL ] Failed to prepare images for instance i-3C270757 (error=1)
[Tue Sep 7 17:35:08 2010][012277][EUCAERROR ] libvirt: GET operation failed: xend_get: error from xen daemon: (code=10)
[Tue Sep 7 17:35:08 2010][012277][EUCAINFO ] vrun(): [rm -rf /usr/local/eucalyptus/admin/i-3C270757/]
[Tue Sep 7 17:35:08 2010][012277][EUCADEBUG ] doDescribeResource() invoked
[Tue Sep 7 17:35:08 2010][012277][EUCADEBUG ] doDescribeInstances() invoked
[Tue Sep 7 17:35:11 2010][012277][EUCAINFO ] doTerminateInstance() invoked (id=i-45A10836)
[Tue Sep 7 17:35:11 2010][012277][EUCAERROR ] libvirt: GET operation failed: xend_get: error from xen daemon: (code=10)
[Tue Sep 7 17:35:11 2010][012277][EUCAWARN ] warning: domain i-45A10836 to be terminated not running on hypervisor
[Tue Sep 7 17:35:11 2010][012277][EUCAINFO ] doTerminateInstance() invoked (id=i-3C270757)
[Tue Sep 7 17:35:11 2010][012277][EUCAERROR ] libvirt: GET operation failed: xend_get: error from xen daemon: (code=10)
[Tue Sep 7 17:35:11 2010][012277][EUCAWARN ] warning: domain i-3C270757 to be terminated not running on hypervisor
[Tue Sep 7 17:35:13 2010][012277][EUCAERROR ] libvirt: GET operation failed: xend_get: error from xen daemon: (code=10)
[Tue Sep 7 17:35:13 2010][012277][EUCAINFO ] vrun(): [rm -rf /usr/local/eucalyptus/admin/i-45A10836/]
[Tue Sep 7 17:35:13 2010][012277][EUCAERROR ] libvirt: GET operation failed: xend_get: error from xen daemon: (code=10)
[Tue Sep 7 17:35:13 2010][012277][EUCAINFO ] vrun(): [rm -rf /usr/local/eucalyptus/admin/i-3C270757/]
[Tue Sep 7 17:35:14 2010][012277][EUCADEBUG ] doDescribeResource() invoked
[Tue Sep 7 17:35:14 2010][012277][EUCADEBUG ] doDescribeInstances() invoked
[Tue Sep 7 17:35:16 2010][012277][EUCAINFO ] doTerminateInstance() invoked (id=i-3C270757)
[Tue Sep 7 17:35:16 2010][012277][EUCAERROR ] libvirt: GET operation failed: xend_get: error from xen daemon: (code=10)
[Tue Sep 7 17:35:16 2010][012277][EUCAWARN ] warning: domain i-3C270757 to be terminated not running on hypervisor
[Tue Sep 7 17:35:18 2010][012277][EUCAERROR ] libvirt: GET operation failed: xend_get: error from xen daemon: (code=10)
[Tue Sep 7 17:35:18 2010][012277][EUCAINFO ] vrun(): [rm -rf /usr/local/eucalyptus/admin/i-3C270757/]
hi graziano
I tried changing the ip of the walrus and cluster during the test.Only in the admin interface it got changed not in the CLI.if i try using euca_conf -it gives me error saying not a valid eucalyptus configuration file
Now i have made a managed mode setup which shows availability zone but i cannot run the instance
i get the public and private ip address to the instance as specified
but i find the error with walrus
but if i try to deregister walrus :
I always get the message 192.168.61.1 is not a valid eucalyptus configuration file
So there is nothing to change with the walrus
Moreover I cant have passwordless ssh as eucalyptus user now( i donot know how it has happened..!!!i cannot resolve that also.i tried no.of times to create ssh-keygen but invain.It is working for the root user alone)
but as eucalyptus user I can do virsh list
but I can sync keys for the nodes using euca_conf -synckeys
Walrus /CLC in one system:
eth0 192.168.61.1
eth1 172.16.1.1
Walrus registered with ip 192.168.61.1
Cluster registered with ip 172.16.1.1
Nodes with ip 172.16.1.2 and 172.16.1.3
VNET_SUBNET= 172.16.0.0
SUBNET_MASK=255.255.0.0
Is that ok with the setup we made ?
Please help me...
Hi
Still the same error persists
Once again i changed some of the network configuration in managed mode.
Front end:
eth0 (Public ip register with Walrus,SC) -192.168.61.1
eth1 (IP registered with cluster) -172.16.1.1
VNET_SUBNET =10.0.0.0 SUBNETMASK=255.0.0.0
Node 1:
eth0 -172.16.1.2
Node 2;
eth0-172.16.1.3
Eucalyptus 1.6
Xen hypervisor 3.2
#euca-describe-availability-zones
root@chncloud3[~]#euca-describe-availability-zones verbose
AVAILABILITYZONE test 172.16.1.1
AVAILABILITYZONE |- vm types free / max cpu ram disk
AVAILABILITYZONE |- m1.small 0008 / 0008 1 128 10
AVAILABILITYZONE |- c1.medium 0008 / 0008 1 256 10
AVAILABILITYZONE |- m1.large 0008 / 0008 1 512 10
AVAILABILITYZONE |- m1.xlarge 0004 / 0004 2 1024 20
AVAILABILITYZONE |- c1.xlarge 0003 / 0003 2 4096 40
euca-run-instances:
root@chncloud3[~]#euca-run-instances -k final emi-BC590FED
RESERVATION r-479C0870 admin admin-default
INSTANCE i-2DCD057F emi-BC590FED 0.0.0.0 0.0.0.0 pending final 2010-09-15T11:45:54.267Z eki-F0CA10C3 eri-256311A2
euca-describe-instances:
root@chncloud3[~]#euca-describe-instances
RESERVATION r-479C0870 admin default
INSTANCE i-2DCD057F emi-BC590FED 192.168.61.100 10.0.1.2 shutting-down final 0 m1.small 2010-09-15T11:45:54.267Z test eki-F0CA10C3 eri-256311A2
cc.log:
[Wed Sep 15 17:26:53 2010][003905][EUCADEBUG ] vnetSetCCS(): input CC=172.16.1.1
[Wed Sep 15 17:26:53 2010][003905][EUCADEBUG ] vnetSetCCS(): setting localIpId: 0
[Wed Sep 15 17:26:53 2010][002348][EUCAINFO ] DescribeResources(): called
[Wed Sep 15 17:26:53 2010][002348][EUCADEBUG ] DescribeResources(): params: userId=eucalyptus, vmLen=5
[Wed Sep 15 17:26:53 2010][002348][EUCAINFO ] DescribeResources(): resources 8/8 8/8 8/8 4/4 3/3
[Wed Sep 15 17:26:53 2010][002348][EUCADEBUG ] DescribeResources(): done
[Wed Sep 15 17:26:53 2010][002351][EUCAINFO ] DescribeInstances(): called
[Wed Sep 15 17:26:53 2010][002351][EUCADEBUG ] DescribeInstances(): params: userId=eucalyptus, instIdsLen=0
[Wed Sep 15 17:26:53 2010][002351][EUCADEBUG ] DescribeInstances(): done
[Wed Sep 15 17:26:53 2010][002350][EUCAINFO ] DescribePublicAddresses(): called
[Wed Sep 15 17:26:53 2010][002350][EUCADEBUG ] DescribePublicAddresses(): params: userId=eucalyptus
[Wed Sep 15 17:26:53 2010][002350][EUCADEBUG ] DescribePublicAddresses(): done
[Wed Sep 15 17:26:53 2010][003905][EUCADEBUG ] DescribeNetworks(): done
[Wed Sep 15 17:26:57 2010][002419][EUCADEBUG ] monitor_thread(): running
[Wed Sep 15 17:26:57 2010][002419][EUCAINFO ] refresh_resources(): called
[Wed Sep 15 17:26:57 2010][002419][EUCADEBUG ] refresh_resources(): calling http://172.16.1.2:8775/axis2/services/EucalyptusNC
[Wed Sep 15 17:26:57 2010][002419][EUCADEBUG ] refresh_resources(): time left for next op: 30
[Wed Sep 15 17:26:57 2010][002419][EUCADEBUG ] refresh_resources(): node=172.16.1.2 mem=15131/15131 disk=3319/3319 cores=8/8
[Wed Sep 15 17:26:57 2010][002419][EUCADEBUG ] refresh_resources(): calling http://172.16.1.3:8775/axis2/services/EucalyptusNC
[Wed Sep 15 17:26:57 2010][002419][EUCADEBUG ] refresh_resources(): time left for next op: 60
cloud-error.log:
at edu.ucsb.eucalyptus.cloud.cluster.UnassignAddressCallback.verify(UnassignAddressCallback.groovy:127)
at edu.ucsb.eucalyptus.cloud.cluster.QueuedEventCallback.messageReceived(QueuedEventCallback.java:152)
at org.jboss.netty.channel.SimpleChannelHandler.handleUpstream(SimpleChannelHandler.java:105)
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:567)
at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:803)
at com.eucalyptus.ws.handlers.MessageStackHandler.handleUpstream(MessageStackHandler.java:133)
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:567)
at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:803)
at com.eucalyptus.ws.handlers.MessageStackHandler.handleUpstream(MessageStackHandler.java:133)
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:567)
at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:803)
at com.eucalyptus.ws.handlers.MessageStackHandler.handleUpstream(MessageStackHandler.java:133)
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:567)
at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:803)
at com.eucalyptus.ws.handlers.MessageStackHandler.handleUpstream(MessageStackHandler.java:133)
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:567)
at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:803)
at com.eucalyptus.ws.handlers.MessageStackHandler.handleUpstream(MessageStackHandler.java:133)
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:567)
at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:803)
at org.jboss.netty.handler.codec.http.HttpChunkAggregator.messageReceived(HttpChunkAggregator.java:105)
at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:87)
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:567)
at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:803)
at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:385)
at org.jboss.netty.handler.codec.replay.ReplayingDecoder.unfoldAndfireMessageReceived(ReplayingDecoder.java:459)
at org.jboss.netty.handler.codec.replay.ReplayingDecoder.callDecode(ReplayingDecoder.java:443)
at org.jboss.netty.handler.codec.replay.ReplayingDecoder.messageReceived(ReplayingDecoder.java:381)
at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:87)
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:567)
at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:803)
at org.jboss.netty.handler.timeout.ReadTimeoutHandler.messageReceived(ReadTimeoutHandler.java:146)
at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:87)
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:567)
at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:803)
at org.jboss.netty.handler.timeout.IdleStateHandler.messageReceived(IdleStateHandler.java:214)
at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:87)
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:567)
at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:803)
at org.jboss.netty.channel.SimpleChannelHandler.messageReceived(SimpleChannelHandler.java:159)
at com.eucalyptus.ws.handlers.ChannelStateMonitor.messageReceived(ChannelStateMonitor.java:62)
at org.jboss.netty.channel.SimpleChannelHandler.handleUpstream(SimpleChannelHandler.java:105)
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:567)
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:562)
at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:342)
at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:329)
at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:330)
at org.jboss.netty.channel.socket.nio.NioWorker.processSelectedKeys(NioWorker.java:282)
at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:203)
at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:110)
at org.jboss.netty.util.internal.IoWorkerRunnable.run(IoWorkerRunnable.java:53)
at org.jboss.netty.handler.execution.MemoryAwareThreadPoolExecutor$MemoryAwareRunnable.run(MemoryAwareThreadPoolExecutor.java:502)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
cloud-debug.log:
7:30:35 INFO [AbstractClusterMessageDispatcher:New I/O client worker #2-24] :1284552035371:DescribePublicAddressesType:uid:eucalyptus:eucalyptus:MSG_SENT:[DescribePublicAddressesType correlationId=39eac71d-2888-4137-9909-3d2789e70cc3 userId=eucalyptus effectiveUserId=eucalyptus _return=false statusMessage=null]:
17:30:35 INFO [AbstractClusterMessageDispatcher:New I/O client worker #2-24] :1284552035386:DescribePublicAddressesResponseType:uid:eucalyptus:eucalyptus:MSG_SENT:[DescribePublicAddressesResponseType addresses=[192.168.61.100, 192.168.61.101, 192.168.61.102, 192.168.61.103, 192.168.61.104, 192.168.61.105, 192.168.61.106, 192.168.61.107, 192.168.61.108, 192.168.61.109, 192.168.61.110, 192.168.61.111, 192.168.61.112, 192.168.61.113, 192.168.61.114, 192.168.61.115, 192.168.61.116, 192.168.61.117, 192.168.61.118, 192.168.61.119, 192.168.61.120, 192.168.61.121, 192.168.61.122, 192.168.61.123, 192.168.61.124, 192.168.61.125, 192.168.61.126, 192.168.61.127, 192.168.61.128, 192.168.61.129, 192.168.61.130, 192.168.61.131, 192.168.61.132, 192.168.61.133, 192.168.61.134, 192.168.61.135, 192.168.61.136, 192.168.61.137, 192.168.61.138, 192.168.61.139, 192.168.61.140, 192.168.61.141, 192.168.61.142, 192.168.61.143, 192.168.61.144, 192.168.61.145, 192.168.61.146, 192.168.61.147, 192.168.61.148, 192.168.61.149, 192.168.61.150, 192.168.61.151, 192.168.61.152, 192.168.61.153, 192.168.61.154, 192.168.61.155, 192.168.61.156, 192.168.61.157, 192.168.61.158, 192.168.61.159, 192.168.61.160, 192.168.61.161, 192.168.61.162, 192.168.61.163, 192.168.61.164, 192.168.61.165, 192.168.61.166, 192.168.61.167, 192.168.61.168, 192.168.61.169, 192.168.61.170, 192.168.61.171, 192.168.61.172, 192.168.61.173, 192.168.61.174, 192.168.61.175, 192.168.61.176, 192.168.61.177, 192.168.61.178, 192.168.61.179, 192.168.61.180, 192.168.61.181, 192.168.61.182, 192.168.61.183, 192.168.61.184, 192.168.61.185, 192.168.61.186, 192.168.61.187, 192.168.61.188, 192.168.61.189, 192.168.61.190, 192.168.61.191, 192.168.61.192, 192.168.61.193, 192.168.61.194, 192.168.61.195, 192.168.61.196, 192.168.61.197, 192.168.61.198, 192.168.61.199, 192.168.61.200] mapping=[, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] correlationId=39eac71d-2888-4137-9909-3d2789e70cc3 userId=eucalyptus effectiveUserId=null _return=true statusMessage=null]:
17:30:35 INFO [AbstractClusterMessageDispatcher:New I/O client worker #2-23] :1284552035405:VmDescribeResponseType:uid:eucalyptus:eucalyptus:MSG_SENT:[VmDescribeResponseType originCluster=null vms=[] correlationId=61fdaba0-cb27-46fd-9aaf-5ebbed856752 userId=eucalyptus effectiveUserId=null _return=true statusMessage=null]:
17:30:35 INFO [AbstractClusterMessageDispatcher:New I/O client worker #2-22] :1284552035409:DescribeResourcesResponseType:uid:eucalyptus:eucalyptus:MSG_SENT:[DescribeResourcesResponseType resources=[[ResourceType maxInstances:8, instanceType:VmTypeInfo{name='m1.small', memory=128, disk=10, cores=1}, availableInstances:8, metaClass:HandleMetaClass[MetaClassImpl[class edu.ucsb.eucalyptus.msgs.ResourceType]]], [ResourceType maxInstances:8, instanceType:VmTypeInfo{name='c1.medium', memory=256, disk=10, cores=1}, availableInstances:8, metaClass:HandleMetaClass[MetaClassImpl[class edu.ucsb.eucalyptus.msgs.ResourceType]]], [ResourceType maxInstances:8, instanceType:VmTypeInfo{name='m1.large', memory=512, disk=10, cores=1}, availableInstances:8, metaClass:HandleMetaClass[MetaClassImpl[class edu.ucsb.eucalyptus.msgs.ResourceType]]], [ResourceType maxInstances:4, instanceType:VmTypeInfo{name='m1.xlarge', memory=1024, disk=20, cores=2}, availableInstances:4, metaClass:HandleMetaClass[MetaClassImpl[class edu.ucsb.eucalyptus.msgs.ResourceType]]], [ResourceType maxInstances:3, instanceType:VmTypeInfo{name='c1.xlarge', memory=4096, disk=40, cores=2}, availableInstances:3, metaClass:HandleMetaClass[MetaClassImpl[class edu.ucsb.eucalyptus.msgs.ResourceType]]]] serviceTags=[http://172.16.1.2:8775/axis2/services/EucalyptusNC, http://172.16.1.3:8775/axis2/services/EucalyptusNC] correlationId=02056224-bff3-4f65-a9ef-ecc0845831cd userId=eucalyptus effectiveUserId=null _return=true statusMessage=null]:
17:30:35 INFO [AbstractClusterMessageDispatcher:New I/O client worker #2-21] :1284552035409:DescribeNetworksResponseType:uid:eucalyptus:eucalyptus:MSG_SENT:[DescribeNetworksResponseType mode=1 addrsPerNetwork=32 activeNetworks=[] correlationId=44c48cbd-8913-49bc-97a0-021e5f7cda90 userId=eucalyptus effectiveUserId=null _return=true statusMessage=null]:
17:30:35 DEBUG [ClusterNodeState:New I/O client worker #2-22] --------------------------------------------------------------------------------
Resource update for cluster=test, outstanding=0 pending=0 submitted=0 redeemed=0
--------------------------------------------------------------------------------
17:30:35 DEBUG [ClusterNodeState:New I/O client worker #2-22] -> BEFORE: [ m1.small available=8/8 c1.medium available=8/8 m1.large available=8/8 m1.xlarge available=4/4 c1.xlarge available=3/3 ]
17:30:35 DEBUG [ClusterNodeState:New I/O client worker #2-22] -> AFTER: [ m1.small available=8/8 c1.medium available=8/8 m1.large available=8/8 m1.xlarge available=4/4 c1.xlarge available=3/3 ]
17:30:35 DEBUG [NetworkStateHandler:New I/O client worker #2-22] Adding node service tags: [http://172.16.1.2:8775/axis2/services/EucalyptusNC, http://172.16.1.3:8775/axis2/services/EucalyptusNC]
httpd-cc_error_log:
Internet Systems Consortium DHCP Server V3.1.1
Copyright 2004-2008 Internet Systems Consortium.
All rights reserved.
For info, please visit http://www.isc.org/sw/dhcp/
WARNING: Host declarations are global. They are not limited to the scope you declared them in.
Wrote 0 deleted host decls to leases file.
Wrote 0 new dynamic host decls to leases file.
Wrote 0 leases to leases file.
No subnet declaration for eth1 (169.254.169.254).
** Ignoring requests on eth1. If this is not what
you want, please write a subnet declaration
in your dhcpd.conf file for the network segment
to which interface eth1 is attached. **
Listening on LPF/eucabr10/00:21:5a:d3:ec:e3/euca
Sending on LPF/eucabr10/00:21:5a:d3:ec:e3/euca
Sending on Socket/fallback/fallback-net
RTNETLINK answers: Cannot assign requested address
iptables-restore: line 10 failed
iptables-restore failed
iptables-restore: line 9 failed
iptables-restore failed
iptables-restore: line 8 failed
iptables-restore failed
walrus-stats.log:
Timestamp: 2010-09-14 18:03:08,432 Service: Walrus Version: 1.6.2 Bytes In: 0 Bytes Out: 0 Buckets: 32 Space Used: 3370727917
Timestamp: 2010-09-14 18:16:25,807 Service: Walrus Version: 1.6.2 Bytes In: 0 Bytes Out: 0 Buckets: 32 Space Used: 3370727917
Timestamp: 2010-09-14 18:17:43,941 Service: Walrus Version: 1.6.2 Bytes In: 0 Bytes Out: 0 Buckets: 32 Space Used: 3370727917
Timestamp: 2010-09-15 10:23:15,720 Service: Walrus Version: 1.6.2 Bytes In: 0 Bytes Out: 0 Buckets: 32 Space Used: 3370727917
Timestamp: 2010-09-15 11:06:07,287 Service: Walrus Version: 1.6.2 Bytes In: 0 Bytes Out: 0 Buckets: 32 Space Used: 3370727917
Timestamp: 2010-09-15 14:54:53,032 Service: Walrus Version: 1.6.2 Bytes In: 0 Bytes Out: 0 Buckets: 32 Space Used: 3370727917
Timestamp: 2010-09-15 16:01:54,228 Service: Walrus Version: 1.6.2 Bytes In: 0 Bytes Out: 0 Buckets: 32 Space Used: 3370727917
Timestamp: 2010-09-15 16:12:07,108 Service: Walrus Version: 1.6.2 Bytes In: 0 Bytes Out: 0 Buckets: 32 Space Used: 3370727917
nc.log:
[Wed Sep 15 17:43:53 2010][013661][EUCAINFO ] network started for instance i-3CD907AF
[Wed Sep 15 17:43:53 2010][013661][EUCAINFO ] retrieving images for instance i-3CD907AF (disk limit=10240MB)...
[Wed Sep 15 17:43:53 2010][013661][EUCAINFO ] walrus_request(): downloading /usr/local/eucalyptus/admin/i-3CD907AF/kernel-digest
[Wed Sep 15 17:43:53 2010][013661][EUCAINFO ] from http://192.168.61.1:8773/services/Walrus/debker/vmlinuz-2.6.24-19-xen.ma...
[Wed Sep 15 17:43:53 2010][013661][EUCADEBUG ] walrus_request(): writing GET output to /usr/local/eucalyptus/admin/i-3CD907AF/kernel-digest
[Wed Sep 15 17:43:53 2010][013661][EUCADEBUG ] walrus_request(): wrote 1173 bytes in 0 writes
[Wed Sep 15 17:43:53 2010][013661][EUCAERROR ] walrus_request(): server responded with HTTP code 403
[Wed Sep 15 17:43:53 2010][013661][EUCAINFO ] walrus_request(): due to error, removing /usr/local/eucalyptus/admin/i-3CD907AF/kernel-digest
[Wed Sep 15 17:43:53 2010][013661][EUCAERROR ] error: failed to obtain digest from http://192.168.61.1:8773/services/Walrus/debker/vmlinuz-2.6.24-19-xen.ma...
[Wed Sep 15 17:43:53 2010][013661][EUCAERROR ] get_cached_file() failed (errno=1)
[Wed Sep 15 17:43:53 2010][013661][EUCAFATAL ] Failed to prepare images for instance i-3CD907AF (error=1)
[Wed Sep 15 17:43:57 2010][013661][EUCAERROR ] libvirt: GET operation failed: xend_get: error from xen daemon: (code=10)
[Wed Sep 15 17:43:57 2010][013661][EUCAINFO ] vrun(): [rm -rf /usr/local/eucalyptus/admin/i-3CD907AF/]
[Wed Sep 15 17:43:57 2010][013661][EUCAINFO ] stopping the network (vlan=10)
[Wed Sep 15 17:43:58 2010][013661][EUCADEBUG ] doDescribeResource() invoked
[Wed Sep 15 17:43:58 2010][013661][EUCADEBUG ] doDescribeInstances() invoked
[Wed Sep 15 17:43:58 2010][013661][EUCAINFO ] doTerminateInstance() invoked (id=i-3CD907AF)
[Wed Sep 15 17:43:58 2010][013661][EUCAERROR ] libvirt: GET operation failed: xend_get: error from xen daemon: (code=10)
[Wed Sep 15 17:43:58 2010][013661][EUCAWARN ] warning: domain i-3CD907AF to be terminated not running on hypervisor
[Wed Sep 15 17:44:02 2010][013661][EUCAERROR ] libvirt: GET operation failed: xend_get: error from xen daemon: (code=10)
[Wed Sep 15 17:44:02 2010][013661][EUCAINFO ] vrun(): [rm -rf /usr/local/eucalyptus/admin/i-3CD907AF/]
[Wed Sep 15 17:44:02 2010][013661][EUCAINFO ] stopping the network (vlan=10)
[Wed Sep 15 17:44:04 2010][013661][EUCADEBUG ] doDescribeResource() invoked
[Wed Sep 15 17:44:04 2010][013661][EUCADEBUG ] doDescribeInstances() invoked
[Wed Sep 15 17:44:04 2010][013661][EUCAINFO ] doTerminateInstance() invoked (id=i-3CD907AF)
[Wed Sep 15 17:44:04 2010][013661][EUCAERROR ] libvirt: GET operation failed: xend_get: error from xen daemon: (code=10)
[Wed Sep 15 17:44:04 2010][013661][EUCAWARN ] warning: domain i-3CD907AF to be terminated not running on hypervisor
ifconfig -a:
root@chncloud3[~]#ifconfig -a
eth0 Link encap:Ethernet HWaddr 00:21:5a:d3:ec:e2
inet addr:192.168.61.1 Bcast:192.168.61.255 Mask:255.255.255.0
inet6 addr: fe80::221:5aff:fed3:ece2/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:22226 errors:0 dropped:0 overruns:0 frame:0
TX packets:7707 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:3867037 (3.6 MiB) TX bytes:1939262 (1.8 MiB)
Interrupt:17
eth1 Link encap:Ethernet HWaddr 00:21:5a:d3:ec:e3
inet addr:169.254.169.254 Bcast:0.0.0.0 Mask:255.255.255.255
inet6 addr: fe80::221:5aff:fed3:ece3/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:63602 errors:0 dropped:0 overruns:0 frame:0
TX packets:67486 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:26860898 (25.6 MiB) TX bytes:23928195 (22.8 MiB)
Interrupt:18
eth1.10 Link encap:Ethernet HWaddr 00:21:5a:d3:ec:e3
inet addr:10.0.0.1 Bcast:10.255.255.255 Mask:255.0.0.0
inet6 addr: fe80::221:5aff:fed3:ece3/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:51 errors:0 dropped:0 overruns:0 frame:0
TX packets:58 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:9108 (8.8 KiB) TX bytes:10348 (10.1 KiB)
eucabr10 Link encap:Ethernet HWaddr 00:00:00:00:00:00
BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:59 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:14316 (13.9 KiB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:627631 errors:0 dropped:0 overruns:0 frame:0
TX packets:627631 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:322425177 (307.4 MiB) TX bytes:322425177 (307.4 MiB)
brctl show(NODE 1):
root@chncloud4[~]#brctl show
bridge name bridge id STP enabled interfaces
eth0 8000.00215ad3ecf4 no peth0
eucabr10 8000.000000000000 no
dhcpd (Front End)
root@chncloud3[~]#ps axww | grep dhcpd
4922 ? Ss 0:00 /usr/sbin/dhcpd3 -q
12387 ? Ss 0:00 /usr/sbin/dhcpd3 -cf /opt/eucalyptus//var/run/eucalyptus/net/euca-dhcp.conf -lf /opt/eucalyptus//var/run/eucalyptus/net/euca-dhcp.leases -pf /opt/eucalyptus//var/run/eucalyptus/net/euca-dhcp.pid -tf /opt/eucalyptus//var/run/eucalyptus/net/euca-dhcp.trace eucabr10 eth1
13559 pts/1 R+ 0:00 grep dhcpd
firewall :
root@chncloud3[~]#iptables -L -t nat
Chain PREROUTING (policy ACCEPT)
target prot opt source destination
DNAT tcp -- 10.0.0.0/8 169.254.169.254 tcp dpt:www to:169.254.169.254:8773
Chain POSTROUTING (policy ACCEPT)
target prot opt source destination
MASQUERADE all -- !loopback/8 !10.0.0.0/8
Chain OUTPUT (policy ACCEPT)
target prot opt source destination
iptables -save:
root@chncloud3[~]#iptables-save
# Generated by iptables-save v1.4.1.1 on Wed Sep 15 17:54:53 2010
*nat
:PREROUTING ACCEPT [36:4877]
:POSTROUTING ACCEPT [30:4782]
:OUTPUT ACCEPT [1021:64879]
-A PREROUTING -s 10.0.0.0/8 -d 169.254.169.254/32 -p tcp -m tcp --dport 80 -j DNAT --to-destination 169.254.169.254:8773
-A POSTROUTING -s ! 127.0.0.0/8 -d ! 10.0.0.0/8 -j MASQUERADE
COMMIT
# Completed on Wed Sep 15 17:54:53 2010
# Generated by iptables-save v1.4.1.1 on Wed Sep 15 17:54:53 2010
*filter
:INPUT ACCEPT [23171:11510021]
:FORWARD DROP [5:444]
:OUTPUT ACCEPT [22667:11214083]
-A FORWARD -m conntrack --ctstate ESTABLISHED -j ACCEPT
-A FORWARD -d ! 10.0.0.0/8 -j ACCEPT
COMMIT
# Completed on Wed Sep 15 17:54:53 2010
If u need some more details please do infm.Please help me out !!!
Hello,
if you changed the IP of the frontend, it could be that eucalyptus is not confused since the registration of the component happened with a different IP. If you really want to debug this issue, you may have to see walrus is still registered with eucalyptus: you can check that with euca_conf --list-walruses and then you can check on the webUI if all looks good under the configuration tab. Finally you can try to upload a new image/kernel to see if walrus is correctly detected and used.
The alternative would be to remove the whole state and restart fresh: in particular the database under /var/lib/eucalyptus/db you can make a copy of everything, just in case, and then move it away (do this only when all eucalyptus component have been stopped). After that you should be able to restart fresh, re-registering all components and go from there.
cheers
graziano