ssk’s posterous

ssk’s posterous

ssk  //  http://twitter.com/notentact

Filed under

amazons3

See all posts on posterous with this tag »
Nov 21 / 12:01am

prefix を外すとどうなるか

by ssk
>> :~/src/thrudb/tutorial/py# python BookmarkExample.py
>> Traceback (most recent call last):
>> File "BookmarkExample.py", line 194, in
>> bm.load_tsv_file("../bookmarks.tsv")
>> File "BookmarkExample.py", line 82, in load_tsv_file
>> self.add_bookmark(b)
>> File "BookmarkExample.py", line 89, in add_bookmark
>> bid = self.store_bookmark(b)
>> File "BookmarkExample.py", line 100, in store_bookmark
>> bid = self.thrudoc.putValue(THRUDOC_BUCKET, b_str)
>> File "../gen-py/Thrudoc/Thrudoc.py", line 242, in putValue
>> return self.recv_putValue()
>> File "../gen-py/Thrudoc/Thrudoc.py", line 266, in recv_putValue
>> raise result.e
>> Thrudoc.ttypes.ThrudocException: ThrudocException(what='S3Backend
error', type=1)

S3Backend error になるのでなんか入れないとだめ

Filed under  //  amazonEC2   amazonS3   python  

Comments (0)

Nov 20 / 11:39pm

Thrudb error message

by ssk

s3 buffer:
<?xml version="1.0" encoding="UTF-8"?>
<Error><Code>NoSuchKey</Code><Message>The specified key does not exist.</Message><Key>td_bookmarks</Key><RequestId>1FFCA809BE735AF4</RequestId><HostId>+xGw8qmEXQ1Ep2q0jHjFbrXHurwp/YNAN8Yxzfvsmkmy45VirPLSv8tdIdmaEekv</HostId></Error>izati�Traceback (most recent call last):
  File "BookmarkExample.py", line 197, in <module>
    bm.remove_all()
  File "BookmarkExample.py", line 125, in remove_all
    for ids in chunker(seed, 100, self.thrudoc.scan):
  File "BookmarkExample.py", line 28, in chunker
    chunk = func(THRUDOC_BUCKET, seed, size)
  File "../gen-py/Thrudoc/Thrudoc.py", line 277, in scan
    return self.recv_scan()
  File "../gen-py/Thrudoc/Thrudoc.py", line 290, in recv_scan
    (fname, mtype, rseqid) = self._iprot.readMessageBegin()
  File "usr/lib/python2.5/site-packages/thrift/protocol/TBinaryProtocol.py", line 126, in readMessageBegin
  File "usr/lib/python2.5/site-packages/thrift/protocol/TBinaryProtocol.py", line 203, in readI32
  File "usr/lib/python2.5/site-packages/thrift/transport/TTransport.py", line 58, in readAll
  File "usr/lib/python2.5/site-packages/thrift/transport/TTransport.py", line 267, in read
  File "usr/lib/python2.5/site-packages/thrift/transport/TTransport.py", line 271, in readFrame
  File "usr/lib/python2.5/site-packages/thrift/transport/TTransport.py", line 58, in readAll
  File "usr/lib/python2.5/site-packages/thrift/transport/TSocket.py", line 94, in read
thrift.transport.TTransport.TTransportException: TSocket read 0 bytes

 

エラーが出るが s3 バケットは出来ていた。

Filed under  //  amazonEC2   amazonS3   python  

Comments (0)

Nov 14 / 12:30am

Setting up Thrudb with S3 backend or other persistant backend - Thrudb | Google グループ

by ssk
ake Luciani  
プロフィールを表示   日本語に翻訳 翻訳（オリジナルを表示）
 詳細オプション 2008年11月14日, 午前11:04

> Am I missing anything in the config? Both thrudoc/thrudex should be talking
> to s3 right and should every should be persistent right?

No Thrudex is not on s3.  The idea is you rebuild the index based on
the data in thrudoc on restart or recover from a backup.
Also you can use the EBS to create a persistent disk for the index.
via groups.google.com

thrudex は s3 に置けないから EBS に置け、とのこと

Filed under  //  amazonS3   thrudb  

Comments (0)

Jun 27 / 12:42am

Amazon S3 message.

by ssk

よくある名前にはできないってことですね。

Filed under  //  amazonS3  

Comments (0)

May 9 / 12:15am

Amazon EC2 with S3 part1

by ssk
create os image and upload image file to S3 space.
 
> domU-12-31-39-03-CE-45:/mnt# ec2-bundle-vol -d /mnt -k ~/.ec2/pk-XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.pem -c ~/.ec2/cert-YYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYY.pem -u NNNNNNNNNNNN
> Please specify a value for arch [i386]:
> Copying / into the image file /mnt/image...
> Excluding:
> /selinux
> /sys
> /proc/bus/usb
> /proc
> /dev/pts
> /dev
> /media
> /mnt
> /proc
> /sys
> /etc/udev/rules.d/70-persistent-net.rules
> /etc/udev/rules.d/z25_persistent-net.rules
> /mnt/image
> /mnt/img-mnt
> 1+0 records in
> 1+0 records out
> 1048576 bytes (1.0 MB) copied, 0.010064 s, 104 MB/s
> mke2fs 1.41.3 (12-Oct-2008)
> Bundling image file...
> Splitting /mnt/image.tar.gz.enc...
> Created image.part.00
> Created image.part.01
> Created image.part.02
> Created image.part.03
> Created image.part.04
> Created image.part.05
> Created image.part.06
> Created image.part.07
> Created image.part.08
> Created image.part.09
> Created image.part.10
> Created image.part.11
> Created image.part.12
> Created image.part.13
> Created image.part.14
> Created image.part.15
> Created image.part.16
> Created image.part.17
> Created image.part.18
> Created image.part.19
> Created image.part.20
> Created image.part.21
> Generating digests for each part...
> Digests generated.
> Unable to read instance meta-data for product-codes
> Creating bundle manifest...
> ec2-bundle-vol complete.
>
> domU-12-31-39-03-CE-45:/mnt# ls
> image image.part.04 image.part.10 image.part.16 img-mnt
> image.manifest.xml image.part.05 image.part.11 image.part.17 lost+found
> image.part.00 image.part.06 image.part.12 image.part.18
> image.part.01 image.part.07 image.part.13 image.part.19
> image.part.02 image.part.08 image.part.14 image.part.20
> image.part.03 image.part.09 image.part.15 image.part.21
>
> domU-12-31-39-03-CE-45:/mnt# ec2-upload-bundle -b BUCKET -m image.manifest.xml -a AAAAAAAAAAAAAAAAAAAA -s BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB
> Uploading bundled image parts to the S3 bucket naoto ...
> Uploaded image.part.00
> Uploaded image.part.01
> Uploaded image.part.02
> Uploaded image.part.03
> Uploaded image.part.04
> Uploaded image.part.05
> Uploaded image.part.06
> Uploaded image.part.07
> Uploaded image.part.08
> Uploaded image.part.09
> Uploaded image.part.10
> Uploaded image.part.11
> Uploaded image.part.12
> Uploaded image.part.13
> Uploaded image.part.14
> Uploaded image.part.15
> Uploaded image.part.16
> Uploaded image.part.17
> Uploaded image.part.18
> Uploaded image.part.19
> Uploaded image.part.20
> Uploaded image.part.21
> Uploading manifest ...
> Uploaded manifest.
> Bundle upload completed.
Filed under  //  amazon   amazonEC2   amazonS3   cloud  

Comments (0)