sql server - SSIS ETL package intermittently loads partial data -


i have ssis package uses sql statements pull data 10 postgres databases identical schemas different data. package written job 10 tasks, each task has hardcoded values indicating server pull data from. source sql doesn't change, , db schemas across 10 source servers identical, data different. basically, we're running data extract against 10 instances of app's backend on loop.

we use 32-bit odbc driver connect postgres sql server 2008 r2 via system dsn connections. don't use fetch because works larger reports fails smaller ones.

on target sql server side, after each run result data each sql statement gets appended same table source id. way can query single table or of 10 sources' data. each day package runs, gets truncated , reloaded. on source side, data staged via backup/restore around 6 am; our jobs start around 8 am. ssis etl dumps data intake bucket, , actual final insert user-facing tables happens via stored procedure.

to summarize,

we have package several sql data transformation tasks. hits 10 pg databases 1 @ time via global variables in job tasks. loads data intake tables, , stored proc inserts final customer tables.

here's weird problem having -- loads correctly, half of data, nothing @ all. tasks complete, complete target tables contain no data. when run package manually (by kicking off job via t-sql or opening in visual studio), works 100% of time. schedule package, can't consistency. i've tried scheduling them during different times of day no avail ... checked upstream people make sure not pulling when pushing, seems ok.

the thing can think of obscure timeout settings in ssis kill jobs when run long. can understand results or no results, halfway loaded tables don't understand. can point me in right direction? thanks.


-

Comments

Post a Comment

Popular posts from this blog

c# - Binding a comma separated list to a List<int> in asp.net web api -

the default binder in web api expecst http://url.com/webapi/report/?pageids=3243&pageids=2365 to bind public ihttpactionresult report(list<int> pageids){ // exciting webapi code} i wish bind http://url.com/webapi/report/?pageids=3243,2365 as running out of space in url get . i have created class public class commaseparatedmodelbinder : system.web.http.modelbinding.imodelbinder { public bool bindmodel(httpactioncontext actioncontext, modelbindingcontext bindingcontext) { //binding in here } } and registered in webapiconfig.cs var provider = new simplemodelbinderprovider( typeof(list<int>), new commaseparatedmodelbinder()); config.services.insert(typeof(modelbinderprovider), 0, provider); i have altered method signature use model binder so public ihttpactionresult report( [modelbinder] list<int> pageids){ // exciting webapi code} however break point in binder not being
Read more

Delphi 7 and decode UTF-8 base64 -

in delphi 7, have widestring encoded base64(that received web service widestring result) : pd94bwwgdmvyc2lvbj0ims4wij8+dqo8c3ryaw5nptiq2lpyqjwvc3ryaw5npg== when decoded it, result not utf-8: <?xml version="1.0"?> <string>طھط³طھ</string> but when decoded base64decode.org, result true : <?xml version="1.0"?> <string>تست</string> i have use encddecd unit decodestring function. the problem have using decodestring . function, in delphi 7, treats decoded binary data being ansi encoded. , problem text utf-8 encoded. to continue encddecd unit have couple of options. can switch decodestream . instance, code produce utf-8 encoded text file data: {$apptype console} uses classes, encddecd; const data = 'pd94bwwgdmvyc2lvbj0ims4wij8+dqo8c3ryaw5nptiq2lpyqjwvc3ryaw5npg=='; var input: tstringstream; output: tfilestream; begin input := tstringstream.create(data); try output := tfilestream.
Read more

html - Is there any way to exclude a single element from the style? (Bootstrap) -

so, have img logo, overlaid on div styled background-image: url("...") , , both elements inside 2 div classes .to-color , .to-overlay respectively, black transparent overlay. is there way exclude logo style given these 2 classes? here's jsfiddle example: link html , css example: - html - <div class="to-color"> <div class="to-overlay"> <div class="respo"> <div class="row"> <div class="col-xs-4 col-xs-offset-4 text-center"> <img src="http://ansonalex.com/wp-content/uploads/2011/06/google-logo-768x260.png" alt="..." class="img-responsive"> </div> </div> </div> </div> </div> - css - .to-color { background-color: #000; } .to-overlay { opacity : 0.5; } .respo { background-image: url("https://source.unsplash.com/category/objects/1600x900"); background-position: center center;
Read more