Extensive list of Amazon services resources

Tools

• Simple Command-Line Access to Amazon EC2 and Amazon S3: + project page
• EC2
  • EC2 AMI Tools
  • EC2 Command-Line Tools
  • EC2 AMIs
  • Cleaning up EC2 Images, AMIs, and Instance
  • EC2 New Instance Types
• S3
  • Amazon S3 Firefox Organizer S3Fox
  • Bucket Explorer
  • S3tools project
  • Jungle Disk
  • S3Drive Windows app
  • S3Browse
  • CLI to Amazon S3 Service using Ruby
• A MySQL Storage Engine for AWS S3

Backups on S3

• Why I Started Using Amazon S3
• Backing Up Flickr Photos with Amazon S3 (Python scripts)
• Amazon S3 PHP Class Update (PHP)
• File Uploads to Amazon S3 the AJAX way thanks to Dojo
• How I automated my backups to Amazon S3 using s3sync
• S3 Backup – Fail-safe, Encrypted Online Backup

Amazon S3 Resources

• Amazon S3: 16 Sites and Resources, Example
• CacheFly vs. Amazon S3
• Using Amazon S3 as in Image Hosting Service
• Introduction to Amazon S3 with Java and REST
• Automated Server Pool Management in Java
• Running Hadoop MapReduce on EC2 and S3 + Sample code

Amazon SimpleDB Resources

• What You Need to Know about Amazon SimpleDB
• Amazon SimpleDB – Limited Beta
• Amazon SimpleDB Developer Guide
• Amazon SimpleDB. What nobody is talking about?
• Eventual consistency
• Relating to SimpleDB
• Query 101: Building SimpleDB Queries
• Query 201: Tips & Tricks for SimpleDB Query

---

Amazon S3 Tips & Tricks

CNAME + domain name

You can create a CNAME record off your domain and point it to s3.amazonaws.com, creating a branded URL to your S3 bucket. Your bucket name must also match the CNAME + domain name.
So, you could create a CNAME record named “S3” and point it to s3.amazonaws.com. Then, create a bucket called “s3.codinghorror.com” in your S3 account and place all your static stuff there. Then, when you create the reference in your code you can use “s3.codinghorror.com”.

Virtual Hosting of Buckets

Virtual Hosting of Buckets

Past issues

S3 was designed for occasionally sharing large files, not “often sharing” small files. Ping times can be over a second, sometimes 2. It is great for 80 meg files every once in a while, but not for 15k PINGs 100,000 times a day.

S3 still seems to have some problems with speed. When serving greater than 60,000 hits per day, the images load VERY slowly. Except on days where it’s so slow it’s not even loading. We like the idea of s3, but we switched back to hosting our own images on likebetter.com after too many speed issues. Also, about 1 in 100 loads fail randomly.

---

Amazon Services Code

Java

• General
  • typica – An Interface to Amazon SQS, EC2 and SimpleDB in Java + typica
• EC2
  • EC2 Library
• S3
  • JetS3t (Amazon S3 library)
  • S3 SOAP Library
  • S3 REST Library
  • S3 Eclipse plugin
  • S3OSCache to Store Cached Data on S3 + http://www.lokitech.com/projects/s3oscache/index
  • S3 Key Management
  • S3Shell in Java
• SimpleDB
  • ‘Simple’ SimpleDB code in single Java file/class (240 lines)
  • Java Library for Amazon SimpleDB
  • JPA implementation for SimpleDB + simplejpa
• SQS
  • Amazon SQS Sample in Java
  • REST SQS Demo

Python

• boto: AWS for Python + boto
• EC2 Query
• S3 REST Library
• Monster Muck Mashup – Mass Video Conversion Using AWS

Ruby

• General
  • RightAWS + project page
  • RightScale Ruby library to access Amazon EC2, S3, SQS, and SDB
  • http://ruby-aws.rubyforge.org/ruby-aws/
• EC2
  • Amazon EC2 Ruby Gem + http://rubyforge.org/frs/?group_id=2753 + http://amazon-ec2.rubyforge.org/
  • EC2 Query
• S3
  • Amazon S3 Library for REST in Ruby
  • s3sync.rb and s3cmd.rb tools
  • Using S3 from EC2 with Ruby
  • AWS::S3 S3 REST API
• SimpleDB
  • Using SimpleDB and Rails in No Time with ActiveResource
  • Using SimpleDB with Ruby on Rails (ActiveResource)
• SQS
  • SQS – A Ruby interface to Simple Queue Service + http://sqs.rubyforge.org/
  • Amazon SQS Sample in Ruby
  • Basic Amazon SQS Sample in Ruby
    
    Advertisement