ssk’s posterous

ssk’s posterous

Nov 21 / 12:01am

prefix を外すとどうなるか

by ssk
>> :~/src/thrudb/tutorial/py# python BookmarkExample.py
>> Traceback (most recent call last):
>> File "BookmarkExample.py", line 194, in
>> bm.load_tsv_file("../bookmarks.tsv")
>> File "BookmarkExample.py", line 82, in load_tsv_file
>> self.add_bookmark(b)
>> File "BookmarkExample.py", line 89, in add_bookmark
>> bid = self.store_bookmark(b)
>> File "BookmarkExample.py", line 100, in store_bookmark
>> bid = self.thrudoc.putValue(THRUDOC_BUCKET, b_str)
>> File "../gen-py/Thrudoc/Thrudoc.py", line 242, in putValue
>> return self.recv_putValue()
>> File "../gen-py/Thrudoc/Thrudoc.py", line 266, in recv_putValue
>> raise result.e
>> Thrudoc.ttypes.ThrudocException: ThrudocException(what='S3Backend
error', type=1)

S3Backend error になるのでなんか入れないとだめ

Filed under  //  amazonEC2   amazonS3   python  

Comments (0)

Nov 20 / 11:39pm

Thrudb error message

by ssk

s3 buffer:
<?xml version="1.0" encoding="UTF-8"?>
<Error><Code>NoSuchKey</Code><Message>The specified key does not exist.</Message><Key>td_bookmarks</Key><RequestId>1FFCA809BE735AF4</RequestId><HostId>+xGw8qmEXQ1Ep2q0jHjFbrXHurwp/YNAN8Yxzfvsmkmy45VirPLSv8tdIdmaEekv</HostId></Error>izati�Traceback (most recent call last):
  File "BookmarkExample.py", line 197, in <module>
    bm.remove_all()
  File "BookmarkExample.py", line 125, in remove_all
    for ids in chunker(seed, 100, self.thrudoc.scan):
  File "BookmarkExample.py", line 28, in chunker
    chunk = func(THRUDOC_BUCKET, seed, size)
  File "../gen-py/Thrudoc/Thrudoc.py", line 277, in scan
    return self.recv_scan()
  File "../gen-py/Thrudoc/Thrudoc.py", line 290, in recv_scan
    (fname, mtype, rseqid) = self._iprot.readMessageBegin()
  File "usr/lib/python2.5/site-packages/thrift/protocol/TBinaryProtocol.py", line 126, in readMessageBegin
  File "usr/lib/python2.5/site-packages/thrift/protocol/TBinaryProtocol.py", line 203, in readI32
  File "usr/lib/python2.5/site-packages/thrift/transport/TTransport.py", line 58, in readAll
  File "usr/lib/python2.5/site-packages/thrift/transport/TTransport.py", line 267, in read
  File "usr/lib/python2.5/site-packages/thrift/transport/TTransport.py", line 271, in readFrame
  File "usr/lib/python2.5/site-packages/thrift/transport/TTransport.py", line 58, in readAll
  File "usr/lib/python2.5/site-packages/thrift/transport/TSocket.py", line 94, in read
thrift.transport.TTransport.TTransportException: TSocket read 0 bytes

 

エラーが出るが s3 バケットは出来ていた。

Filed under  //  amazonEC2   amazonS3   python  

Comments (0)

Sep 26 / 1:36am

2606-36J: Amazon EBS Snapshotスクリプト

by ssk
cronなんかに
0 0 * * * /path/to/snapshot.py 7 vol-00000000
という感じで登録しておく事を前提に作りました。

  1. #!/usr/bin/env python  
  2.   
  3. import sys  
  4. from boto.ec2.connection import EC2Connection  
  5.   
  6. if(len(sys.argv) != 3):  
  7.     print "Usage: snapshot.py <num> <volume-id>"  
  8.     quit()  
  9.   
  10. conn = EC2Connection('aws_access_key',' aws_secret_access_key');  
  11. conn.create_snapshot(sys.argv[2])  
  12. snapshot = {}  
  13. for x in conn.get_all_snapshots():  
  14.     if(x.volume_id == sys.argv[2]):  
  15.         tmp = {x.id:x.start_time}  
  16.         snapshot.update(tmp)  
  17. snapshot = sorted(snapshot.items(), key=lambda (k, v): (v, k), reverse=True)  
  18. for i in range(int(sys.argv[1]), len(snapshot)):  
  19.     conn.delete_snapshot(snapshot[i][0])  

amazon ec2

Filed under  //  amazonEC2   python  

Comments (0)

Jul 23 / 1:43am

Amazon EC2のReserved Instancesを使ってみる - RX-7乗りの適当な日々

by ssk

EC2 API Toolsのバージョンを確認

使うためには、現状ではAmazon EC2 API Tools(Amazon EC2 Command-Line Tools)が必要です。

バージョンが古い場合は、新しくする必要があります。(2009-03-01版以降が必要かと)

elasticfox ではだめなのかな?

Filed under  //  amazonEC2  

Comments (0)

May 9 / 12:15am

Amazon EC2 with S3 part1

by ssk
create os image and upload image file to S3 space.
 
> domU-12-31-39-03-CE-45:/mnt# ec2-bundle-vol -d /mnt -k ~/.ec2/pk-XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.pem -c ~/.ec2/cert-YYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYY.pem -u NNNNNNNNNNNN
> Please specify a value for arch [i386]:
> Copying / into the image file /mnt/image...
> Excluding:
> /selinux
> /sys
> /proc/bus/usb
> /proc
> /dev/pts
> /dev
> /media
> /mnt
> /proc
> /sys
> /etc/udev/rules.d/70-persistent-net.rules
> /etc/udev/rules.d/z25_persistent-net.rules
> /mnt/image
> /mnt/img-mnt
> 1+0 records in
> 1+0 records out
> 1048576 bytes (1.0 MB) copied, 0.010064 s, 104 MB/s
> mke2fs 1.41.3 (12-Oct-2008)
> Bundling image file...
> Splitting /mnt/image.tar.gz.enc...
> Created image.part.00
> Created image.part.01
> Created image.part.02
> Created image.part.03
> Created image.part.04
> Created image.part.05
> Created image.part.06
> Created image.part.07
> Created image.part.08
> Created image.part.09
> Created image.part.10
> Created image.part.11
> Created image.part.12
> Created image.part.13
> Created image.part.14
> Created image.part.15
> Created image.part.16
> Created image.part.17
> Created image.part.18
> Created image.part.19
> Created image.part.20
> Created image.part.21
> Generating digests for each part...
> Digests generated.
> Unable to read instance meta-data for product-codes
> Creating bundle manifest...
> ec2-bundle-vol complete.
>
> domU-12-31-39-03-CE-45:/mnt# ls
> image image.part.04 image.part.10 image.part.16 img-mnt
> image.manifest.xml image.part.05 image.part.11 image.part.17 lost+found
> image.part.00 image.part.06 image.part.12 image.part.18
> image.part.01 image.part.07 image.part.13 image.part.19
> image.part.02 image.part.08 image.part.14 image.part.20
> image.part.03 image.part.09 image.part.15 image.part.21
>
> domU-12-31-39-03-CE-45:/mnt# ec2-upload-bundle -b BUCKET -m image.manifest.xml -a AAAAAAAAAAAAAAAAAAAA -s BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB
> Uploading bundled image parts to the S3 bucket naoto ...
> Uploaded image.part.00
> Uploaded image.part.01
> Uploaded image.part.02
> Uploaded image.part.03
> Uploaded image.part.04
> Uploaded image.part.05
> Uploaded image.part.06
> Uploaded image.part.07
> Uploaded image.part.08
> Uploaded image.part.09
> Uploaded image.part.10
> Uploaded image.part.11
> Uploaded image.part.12
> Uploaded image.part.13
> Uploaded image.part.14
> Uploaded image.part.15
> Uploaded image.part.16
> Uploaded image.part.17
> Uploaded image.part.18
> Uploaded image.part.19
> Uploaded image.part.20
> Uploaded image.part.21
> Uploading manifest ...
> Uploaded manifest.
> Bundle upload completed.
Filed under  //  amazon   amazonEC2   amazonS3   cloud  

Comments (0)