sql server - SSIS Cross-DB "WHERE IN" Clause (or Equivalent) in Azure -

-

i'm trying build data flow in ssis select records mapping table id column exists in related item table. there 2 complications:

  1. the 2 tables in different databases on different servers.
  2. the databases in azure, i've read linked servers not supported.

to more clear, job migrate data staging environment production. want push lookup records prod if associated item ids in there. here's psudo-tsql give clear goal of i'm trying achieve:

select * [staging_server].[sourcedb].[dbo].[lookup] l l.[id] in (     select p.[item]     [production_server].[targetdb].[dbo].[item] p )

i haven't found way create in ssis. think i've created work-around involves sorting both tables , performing merge join, sorting both sides unnecessary hit on performance. i'm looking more direct , intuitive design seemingly simple data flow.

doing in data flow, you'd have source query, sans filter, fed lookup component subquery.

the challenge ssis on-premises means going pull of data out of stage azure server running ssis , push prod azure instance.

that's lot of network activity , i'm reading azure pricing guide, guess long have appropriate dtus, you'd fine. in day, charged reads , not writes idiom push data target server , comparison there, elendadba mentions. suggestion i'd make on implementation avoid temporary tables or ad-hoc creation/destruction of them. implement physical table , truncate , reload prior transmission production.


Comments

Post a Comment

Popular posts from this blog

html - Styling progress bar with inline style -

-
i trying set progress bar color red using inline style. need in way because have access <body> part of document. style need apply: progress { color: red } progress::-moz-progress-bar { background: red;} progress::-webkit-progress-value { background: red; } progress[aria-valuenow]:before { background: red; } i tried <progress style="background: red;"> incorrect effect, progress bar color turns blue red background. guide right direction desired style? thank in advance. here live example: https://jsfiddle.net/z36d3f6l/
Read more

java - Oracle Sql developer error: could not install some modules -

-
i have downloaded fresh copy of sqldeveloper ( sqldeveloper-4.1.3.20.78-no-jre ) oracle website. when unzip , lauch gui, keep getting following error message: warning - not install modules: dynamic module config - no module providing capability org.netbeans.netbinox found. my system: windows 7 32 bit hp probook. jdk 1.6 , 1.7, 1.8 available in java/jdk subdirectory. netbeans 8.0.2 installed finally got way out after dirty hours. extracted sqldeveloper zip in nested directory. i.e: e://a/b/c/sqldeveloper. starting sqldeveloper gui above directory threw erros. solution: go in c:\users**username**\appdata\roaming : delete sql developer , sqldeveloper folders extract sql developer zip in new non nested directory. i.e: e:// start , should work now reference: https://community.oracle.com/thread/3870680?start=0&tstart=0
Read more

How to use autoclose brackets in Jupyter notebook? -

-
this may sound silly question, how make use of autoclose brackets in jupyter notebook? example, when type print( jupyter notebook auto-closes brakets print() and places cursor inside. type argument, say print(1 + 1) now cursor between second 1 , right bracket ) . key navigate right of ) ? of course can press end or → or ) achieve this, not seem save time, purpose of brackets autoclose suppose? thanks in advance.
Read more