python - Parse text file from content-type=application/zip and base64 encoding in AWS SES -


on amazon ses, have rule save incoming emails s3 buckets. amazon saves these in mime format.

these emails have .txt in attachment shown in mime file content-type=text/plain, content-disposition=attachment ... .txt, , content-transfer-encoding=quoted-printable or bases64.

i able parse fine using python.

i have problem decoding content of .txt file attachment when compressed (i.e., content-type: applcation/zip), if encoding wasn't base64.

my code:

import base64 s = unicode(base64.b64decode(attachment_content), "utf-8")

throws error:

traceback (most recent call last):   file "<input>", line 796, in <module> unicodedecodeerror: 'utf8' codec can't decode byte 0xcf in position 10: invalid continuation byte

below first few lines of "base64" string in attachment_content, btw has length 53683 + "==" @ end, , thought length of base64 should multiple of 4 (??). maybe decoding failing because compression changing attachment_content , need other operation before/after decoding it? have no idea..

uesdbbqaaaaiam9ah0otgkpwx5oaadmtagajaaaax2noyxqudhh0tl3bjirjkix23sd+g0u3ioxu rewgu8c1l2ag8lkd0v2zwajm3kluc6hubu5ufezm3nyjl6+n4t4ry8eodwcsmyqxbrblgmq+7cp5 qpbj5gdyn0cri6jqfxwv7hlyszursijv1g6qoni5cmqyet6dpp9cncat6yvp5yvz6xfje7cp8p/k 1sbl8xfju0osvuvr2q3tonfvwjxrknwzfeuk2vrlu978s19mrvnmrhneov51sozlgutmlynfp0nd  ...

i have tried used "latin-1", gibberish.

the problem that, after conversion, dealing zipped file in format, "pk \x03 \x04 \x3c \xa \x0c ...", , needed unzip before transforming utf-8 unicode.

this code worked me:

import email  # parse results email received_email = email.message_from_string(email_text) part in received_email.walk():     c_type = part.get_content_type()     c_enco = part.get('content-transfer-encoding')      attachment_content = part.get_payload()      if c_enco == 'base64':         import base64         decoded_file = base64.b64decode(attachment_content)         print("file decoded base64")          if c_type == "application/zip":             cstringio import stringio             import zipfile             zfp = zipfile.zipfile(stringio(decoded_file), "r")             unzipped_list = zfp.open(zfp.namelist()[0]).readlines()             decoded_file = "".join(unzipped_list)             print('and un-zipped')      result = unicode(decoded_file, "utf-8")

Comments

Post a Comment

Popular posts from this blog

How to understand 2 main() functions after using uftrace to profile the C++ program? -

i trying uftrace profile following simple c++ program: #include <iostream> class { public: a() {std::cout << "a created" << std::endl;} ~a() {std::cout << "a destroyed" << std::endl;} }; int main() { a; return 0; } the profile result this: # uftrace a.out created destroyed # duration tid function 2.026 [ 4828] | __cxa_atexit(); [ 4828] | main() { [ 4828] | __static_initialization_and_destruction_0() { 89.397 [ 4828] | std::ios_base::init::init(); 0.768 [ 4828] | __cxa_atexit(); 93.029 [ 4828] | } /* __static_initialization_and_destruction_0 */ 94.425 [ 4828] | } /* main */ [ 4828] | main() { [ 4828] | a::a() { 11.104 [ 4828] | std::operator <<(); 10.825 [ 4828] | std::basic_ostream::operator <<(); 24.514 [ 4828] | } /* a::a */ [ 4828] | a::~a() { 0.978 [ 4828] | ...
Read more

c# - Update a combobox from a presenter (MVP) -

i using mvp in project, new in mvp. have 2 comboboxes. when select option in combobox, combobox should filled new data. this action in presenter. view 'view1' in presenter, , introduced combobox1 , combobox2 properties in 'view1', because need 'datasource', 'displaymember', 'valuemember' , 'refresh()' in method below. but, when using pattern, enough send property like public string combobox2 { { return combobox1.selectedvalue.tosstring(); } } into presenter not whole combobox. how can solve problem? public void onselectedindexchangedcombobox1() { if (view1.combobox1.selectedindex == -1) { return; } datatable dt = tools.getdatatable("a path"); var query = (from o in dt.asenumerable() o.field<string>("afield") == farmerview.combobox1.selectedvalue.tostring() orderby o.field<string>("anotherfield") select...
Read more

How to put a lock and transaction on table using spring 4 or above using jdbcTemplate and annotations like @Transactional? -

i trying put lock on table while writing on table , if happened in between roll-back . trying convert below code lock table test_g1 read; lock table test_g write; -- begin; start transaction; insert test_g1 values(143); insert test_g values(145); select * test_g1; select * test_g; rollback; select * test_g; unlock tables; how convert above code @transactional spring jdbctemplate code? @transactional(rollbackfor={dataaccessexception.class}) public void test(){ jdbctemplate.execute("insert test1 (id, nam) values (4, 'a')"); throw new dataaccessexception("error") { }; } here trying throw error, insert statement should rollback it's not happening . thanks edit-1 attaching code , doing in jdbcdaoimpl.java , mentioned problem comment above test() . app.java package com.cgiri.javabrains.spring4; import org.springframework.beans.factory.annotation.autowired; import org.springframework.context.applic...
Read more