• Datastage Complex Flat File Stage Example
• Complex Flat File Stage Datastage Example 3
• Complex Flat File Stage In Datastage With Example

Datastage stages palette – ETL Toolsand QualityStage stages are sorted into the below logical sections:. General Objects. Stages of Data Quality. Development and Debug Stages. Database connectors.

Restructure stages. Real-time stages. Debug and Development stages. Sequence activitiesLooking for top? This blog post gives you all the information you need!The widely and popular stages used in DataStage and Quality Stage are discussed below and specific major features are explained below.

General Elements. A Link indicates the flow of the data. Reference, stream and lookup are the main types of links. The container can be shared or private; the main role is to visually make it simple so that the complex database job design and letting the design for ease of usage and recognition. Annotation is basically used for adding floating and notes on job posts. This provides a way to document ETL process and used in understanding the given job.2. Debug and Development stages.

Row generator replicates a set of data which sticks to the appropriate metadata (cycled or randomized). Useful for development and testing. Column generator can add one or more column to the flow and can generate test data for the column. Peek The column values are recorded and could be viewed in the director. It can have multiple output link, but single input link. Sample operates on an input data set and has two modes:- percent mode and period mode.

Head occupies first N rows at each partition and copies them to an output data set from an input data set. A Tail is same as the head stage. From each of the partitions, last N rows are selected. Write Range Map writes a form where the dataset is usable by the range partitioning method.3.

Processing Stages. Aggregator joins data vertically from grouping the incoming data stream and calculating brief about a min, count, max etc.; for each team. The data could be sorted using two methods: pre-sort and hash table.

Copy copies the input data to single or more output data flows. Cracked version of fl studio 10. FTP stage implements the FTP protocol to transfer data to a remote machine. Filter filters records that don’t meet relevant requirements. Funnel converts multiple streams into a single one. Join combines more than one input according to the values of a key column/s. Lookup includes two or more inputs based on values of key column/s. It should have a 1 source, but can have multiple lookup tables.

Datastage Complex Flat File Stage Example

Merge includes one master input with multiple updates inputs related to the values of a key column/s. The inputs need to be sorted and unmatched secondary entries can be caught using multiple reject links. Modify stage alters the dataset record.

Here i am providing some scenario based questions on datastage. This scenarios not only help you for preparing the interview, these will also help you in improving your technical skills in stage.

Complex Flat File Stage Datastage Example 3

Complex Flat File Stage In Datastage With Example

Try to solve the below scenario based questions.1. Consider the following employees data as source?employeeid, salary-10, 100020, 200030, 300040, 5000Q1. Create a job to load the cumulative sum of salaries of employees into target table?The target table data should look like asemployeeid, salary, cumulativesum-10, 1000, 100020, 2000, 300030, 3000, 600040, 5000, 11000Q2. Create a job to get the pervious row salary for the current row.

If there is no pervious row exists for the current row, then the pervious row salary should be displayed as null.The output should look like asemployeeid, salary, prerowsalary-10, 1000, Null20, 2000, 100030, 3000, 200040, 5000, 3000Q3. Create a job to get the next row salary for the current row. If there is no next row for the current row, then the next row salary should be displayed as null.The output should look like asemployeeid, salary, nextrowsalary-10, 1000, 200020, 2000, 300030, 3000, 500040, 5000, NullQ4. Create a job to find the sum of salaries of all employees and this sum should repeat for all the rows.The output should look like asemployeeid, salary, salarysum-10, 1000, 1100020, 2000, 1100030, 3000, 1100040, 5000, 110002. Consider the following employees table as sourcedepartmentno, employeename-20, R10, A10, D20, P10, B10, C20, Q20, SQ1.

Create a job to load a target table with the following values from the above source?departmentno, employeelist-10, A10, A,B10, A,B,C10, A,B,C,D20, A,B,C,D,P20, A,B,C,D,P,Q20, A,B,C,D,P,Q,R20, A,B,C,D,P,Q,R,SQ2. Create a job to load a target table with the following values from the above source?departmentno, employeelist-10, A10, A,B10, A,B,C10, A,B,C,D20, P20, P,Q20, P,Q,R20, P,Q,R,SQ3. Create a job to load a target table with the following values from the above source?departmentno, employeenames-10, A,B,C,D20, P,Q,R,SRecommended ReadingMore Scenarios Based Interview Questions on Datastage atIf you like this article, then please share it or click on the google +1 button.