Monday 4 November 2019

Data loads to SAP HANA DB using SAP DS (Data Services)

SAP Data services:


SAP Data services is an ETL tool which gives a single enterprise level solution for data Integration, Transformation, Data quality, Data profiling and Text data processing from different source systems into a target DB.

SAP Data services Features:


◈ Single development user interface
◈ Metadata repository
◈ Data connectivity layer
◈ Run-time environment
◈ Management Console

Once we login to DS and open Designer layout, we can see the following elements:

Menu bar across the top, Tool bar under the menu bar, Project Area, Local Object Library with following tabs.

◈ Projects : Use the project area pane to create and manage projects, to monitor job executions, and to view job execution logs.

◈ Jobs : Job is the only object that you execute. A job contains all other subordinate objects in hierarchical order.

◈ Work flows : A work flow defines the decision-making process for executing data flows.

◈ Data flows : A data flow is the process by which the software transforms source data into target data.

◈ Transforms : Transforms operate on data sets by manipulating input sets and producing one or more output sets.

◈ Datastores : Datastores contain connection configurations to databases and applications that contain your data.

◈ Formats : Format is a set of properties that describe the metadata structure of a flat ASCII file.

◈ Custom Functions : When none of SAP Data Services built-in functions match your needs, create a custom function.


Scenario:


We have SAP ECC as source system and HANA DB as target system, this is used to store organizational data centrally for reporting purpose. (and also have different sources systems like MS SQL, Oracle and other applications on different databases, but in this case I’m taking only SAP ECC as source system).

The below is the initial screen of DS.

SAP HANA Tutorial and Materials, SAP HANA Studio, SAP HANA Learning, SAP HANA Study Materials, SAP HANA Online Exam

Give the SAP ECC details like below.

SAP HANA Tutorial and Materials, SAP HANA Studio, SAP HANA Learning, SAP HANA Study Materials, SAP HANA Online Exam

Import the required tables from SAP ECC into DS.

SAP HANA Tutorial and Materials, SAP HANA Studio, SAP HANA Learning, SAP HANA Study Materials, SAP HANA Online Exam

Give table name MARA and Import it.

SAP HANA Tutorial and Materials, SAP HANA Studio, SAP HANA Learning, SAP HANA Study Materials, SAP HANA Online Exam

Create Datastore for HANA DB, we are going to create and load MARA Table data in HANA DB under my Schema.

I’m going to take MARA, MAKT tables and join them, apply some filters and load the data into HANA DB.

SAP HANA Tutorial and Materials, SAP HANA Studio, SAP HANA Learning, SAP HANA Study Materials, SAP HANA Online Exam

Now Under Projects, create new project, under that create a new job, under that create new work flow, under that create new data flow.

Bring two Sources Tables (MARA and MAKT from Datastore) and add Query Transform, join both tables to Query Transform.

SAP HANA Tutorial and Materials, SAP HANA Studio, SAP HANA Learning, SAP HANA Study Materials, SAP HANA Online Exam

Once double click on Query Transform, it will open the below window and there we can Join tables and give filters etc…

SAP HANA Tutorial and Materials, SAP HANA Studio, SAP HANA Learning, SAP HANA Study Materials, SAP HANA Online Exam

Join two tables using MATNR and filter the data using SPRAS (only English). Apart from these we can also have additional functions but I’m not using them, this is simple demo.

SAP HANA Tutorial and Materials, SAP HANA Studio, SAP HANA Learning, SAP HANA Study Materials, SAP HANA Online Exam

Save All and Execute the job.

SAP HANA Tutorial and Materials, SAP HANA Studio, SAP HANA Learning, SAP HANA Study Materials, SAP HANA Online Exam

We can see the Error message, the job is failed. We have to adjust the Data types and again execute.

SAP HANA Tutorial and Materials, SAP HANA Studio, SAP HANA Learning, SAP HANA Study Materials, SAP HANA Online Exam
SAP HANA Tutorial and Materials, SAP HANA Studio, SAP HANA Learning, SAP HANA Study Materials, SAP HANA Online Exam

Save All and Execute again, the job will be SUCCESS and it will create tables in HANA under given Schema.

SAP HANA Tutorial and Materials, SAP HANA Studio, SAP HANA Learning, SAP HANA Study Materials, SAP HANA Online Exam

See the definition and Data of MATERIALS_ECC table.

SAP HANA Tutorial and Materials, SAP HANA Studio, SAP HANA Learning, SAP HANA Study Materials, SAP HANA Online Exam

We can also load the data to NON-SAP systems to do this we have to create separate Datastore in DS and use them for Target (and also Source).

No comments:

Post a Comment