curl - Proxying PUT HTTP requests to AWS S3 fails -


i working on creating proxy relay http requests amazon s3. proxy uses nginx right ngx_aws_auth module adds necessary headers http requests client not need to.

nginx configuration:

http {     include       mime.types;     default_type  application/octet-stream;     sendfile        on;     client_body_in_file_only clean;     client_body_buffer_size 32k;      client_max_body_size 300m;      send_timeout 300s;      keepalive_timeout  65;      gzip  on;   server {     listen     8000;      location / {       proxy_pass https://test-bucket.s3.amazonaws.com;        aws_access_key xxxxx;       aws_secret_key yyyyyy;       s3_bucket test-bucket;        proxy_set_header authorization $s3_auth_token;       proxy_set_header x-amz-date $aws_date;     }   } }

almost except when trying upload larger file.

get:

$ curl -vx http://192.168.99.131:8000/a.txt ; echo * connect() 192.168.99.131 port 8000 (#0) *   trying 192.168.99.131... * connected 192.168.99.131 (192.168.99.131) port 8000 (#0) > /a.txt http/1.1 > user-agent: curl/7.29.0 > host: 192.168.99.131:8000 > accept: */* > < http/1.1 200 ok < server: nginx/1.6.3 < date: sun, 30 aug 2015 18:18:50 gmt < content-type: application/x-www-form-urlencoded < content-length: 1 < connection: keep-alive < x-amz-id-2: 1f/eqtkju= < x-amz-request-id: a970d9bcf5d5890b < last-modified: sat, 29 aug 2015 00:58:33 gmt < etag: "0cc175b9c0f1b6a831c399e269772661" < accept-ranges: bytes < * connection #0 host 192.168.99.131 left intact

put small file:

$ echo 'a'>a;curl -vx put -d @a http://192.168.99.131:8000/a.txt * connect() 192.168.99.131 port 8000 (#0) *   trying 192.168.99.131... * connected 192.168.99.131 (192.168.99.131) port 8000 (#0) > put /a.txt http/1.1 > user-agent: curl/7.29.0 > host: 192.168.99.131:8000 > accept: */* > content-length: 1 > content-type: application/x-www-form-urlencoded > * upload sent off: 1 out of 1 bytes < http/1.1 200 ok < server: nginx/1.6.3 < date: sun, 30 aug 2015 18:20:03 gmt < content-length: 0 < connection: keep-alive < x-amz-id-2: gf/hvpsr+r2r/j7qquf0= < x-amz-request-id: f499d02f2d28b6eb < etag: "0cc175b9c0f1b6a831c399e269772661" < * connection #0 host 192.168.99.131 left intact

put larger file without adjusting header:

curl -vvvx put -d @1408133479717.jpg http://192.168.99.131:8000/a.jpg * connect() 192.168.99.131 port 8000 (#0) *   trying 192.168.99.131... * connected 192.168.99.131 (192.168.99.131) port 8000 (#0) > put /a.jpg http/1.1 > user-agent: curl/7.29.0 > host: 192.168.99.131:8000 > accept: */* > content-length: 320356 > content-type: application/x-www-form-urlencoded > expect: 100-continue > < http/1.1 100 continue < http/1.1 200 ok < server: nginx/1.6.3 < date: sun, 30 aug 2015 18:33:45 gmt < content-length: 0 < connection: keep-alive < x-amz-id-2: im+nmggfzccp+/mfldwdr/zwjfs= < x-amz-request-id: 3b86e54874009d73 < etag: "8d04fbe9d623bf03bb828594ca272063" < * connection #0 host 192.168.99.131 left intact

this uploads partial file size of 320356 bytes, original file 825210 bytes.

put larger file , adjusting header:

[vagrant@gripper nginx]$ curl -vvvx put -h "content-length: 825210" -d @1408133479717.jpg http://192.168.99.131:8000/a.jpg * connect() 192.168.99.131 port 8000 (#0) *   trying 192.168.99.131... * connected 192.168.99.131 (192.168.99.131) port 8000 (#0) > put /a.jpg http/1.1 > user-agent: curl/7.29.0 > host: 192.168.99.131:8000 > accept: */* > content-length: 825210 > content-type: application/x-www-form-urlencoded > expect: 100-continue > < http/1.1 100 continue * empty reply server * connection #0 host 192.168.99.131 left intact curl: (52) empty reply server

my question is:

how can upload file correct size using curl?


-

Comments

Post a Comment

Popular posts from this blog

c# - Binding a comma separated list to a List<int> in asp.net web api -

the default binder in web api expecst http://url.com/webapi/report/?pageids=3243&pageids=2365 to bind public ihttpactionresult report(list<int> pageids){ // exciting webapi code} i wish bind http://url.com/webapi/report/?pageids=3243,2365 as running out of space in url get . i have created class public class commaseparatedmodelbinder : system.web.http.modelbinding.imodelbinder { public bool bindmodel(httpactioncontext actioncontext, modelbindingcontext bindingcontext) { //binding in here } } and registered in webapiconfig.cs var provider = new simplemodelbinderprovider( typeof(list<int>), new commaseparatedmodelbinder()); config.services.insert(typeof(modelbinderprovider), 0, provider); i have altered method signature use model binder so public ihttpactionresult report( [modelbinder] list<int> pageids){ // exciting webapi code} however break point in binder not being ...
Read more

how to prompt save As Box in Excel Interlop c# MVC 4 -

i want export excel sheet using excel interloop... i have datatable convert excel sheet... now there way save file using save dialogue box in mvc 4 here code public string datatabletoexcel(datatable dt, string htmlheading, string key) { try { microsoft.office.interop.excel.application excel; microsoft.office.interop.excel.workbook excelworkbook; microsoft.office.interop.excel.worksheet excelsheet; microsoft.office.interop.excel.range excelcellrange; excel = new microsoft.office.interop.excel.application(); excel.visible = false; excel.displayalerts = false; excelworkbook = excel.workbooks.add(type.missing); excelsheet = (microsoft.office.interop.excel.worksheet)excelworkbook.activesheet; excelsheet.name = "sheet1"; dataset ...
Read more

xslt 1.0 - How to access or retrieve mets content of an item from another item? -

my use case have item has link in item. example, item 123456789/152 has metadata field dc.relation.hasversion=123456789/717 . within item view of 123456789/152 , how can retrieve values of metadata of 123456789/717 ? example, want retrieve dc.language.iso value of 123456789/717 123456789/152 . i looked @ related items feature in dspace don't know how metadata displayed in related items list pulled items in list. i using dspace version 5.3 mirage 2 theme . edit based on schweerelos answer, below actual code. using custom metadata field dc.relation.languageversion . basically, want link other version instead of displaying value, display dc.language.iso of other version in item-view.xsl . i've incorporated answer of schweerelos question in code just displaying value of dc.relation.languageversion . sample values of dc.relation.languageversion 10665.1/9843 ; 10665.1/9844 ie not complete uri handle. thanks in advance! actual code <xsl:template name=...
Read more