【oracle教程】DesigningETLDataFlowMappings【OWB10gRel

Designing Process Flows

Downloaded the owbdemo_files.zip file and extracted the files to the d drive on your computer's hard drive

Completed Lessons 1, 2, and 3

Download Oracle Workflow Server 2.6.4 from here and install it in your Oracle database home. (Download the Oracle Database 10g Companion CD Release 2, which contains Workflow Server. This installation uses Oracle Universal Installer.)

Note: You can also use Oracle Workflow Server2.6.3 with Oracle Warehouse Builder 10g Release 2.

After installing Oracle Workflow Server in your Oracle database home, run theWorkflow Configuration Assistant to create theowf_mgr Workflow schema.

From the Start menu click Programs > Oracle<Database HOME> >Configuration and Migration Tools> Workflow Configuration Assistant. The Assistant is started.

Note for Oracle Workflow 2.6.3: Enter the following values:

Workflow Account: (Accept the default ) owf_mgr
Workflow Password: owf_mgr
SYS Password :
Accept the default for
Install Option
Language Selection
Connect Method
Connect String: orcl OR
Hostname: localhost
JDBC Connection: localhost:1521:orcl
Click Submit

The Workflow Configuration Assistantwindow disappears and the command window displays theowf_mgr schema creation progress details. Do not close this command window. On successful completion, the command window will close automatically. The schema creation takes several minutes. A dialog box appears saying that Workflow Configuration has successfully completed.

Click OK. The command window closes automatically.

Note for Oracle Workflow 2.6.4: When you run the Workflow Configuration Assistant, you need to specify the database connect string in the TNS Connect Descriptor box.

Enter the following values:

Accept the default for Install Option

Workflow Account: (Accept the default ) owf_mgr
Workflow Password: owf_mgr

SYS Password :

TNS Connect Descriptor: localhost:1521:orcl

Click Submit.

In the Project Explorer panel of the Design Center, expand OWB_DEMO. ExpandDatabases > Oracle > SALES_WH > Mappings.Double-click LOAD_CHANNELS.

The Mapping Editor launches the LOAD_CHANNELS mapping.

You design a mapping in Warehouse Builder using the Mapping Editor interface. As you design a mapping, you select operators from the Mapping Editor Palette panel and place them on the canvas.

Tip: If you are not able to see all the objects similar to the following screenshot, then in the Mapping Editor, click Auto-Layout on the toolbar to bring the mapping to its default size. Maximize the operators on the canvas by clicking the maximize icon.

In the Mapping Editor, you see the following operators on the canvas:

a) A Table operator named CHANNELS_IN

b) A Constant operator named TOTALS

c) A Dimension operator named CHANNELS_OUT

d) Connection lines between attributes

In the LOAD_CHANNELS mapping, click the table operator CHANNELS_IN header. This now becomes the currently selected object. Right-click the table operatorCHANNELS_IN header and selectOpen Details. This launches the Operator Editor in tab format.

Each tab helps in performing tasks associated with the operator. For example, the Name tab enables you to specify a name and optional description for the operator.

Click Cancel to close Table Editor.

In the LOAD_CHANNELS mapping, ensure that the CHANNELS_IN table operator is selected. (Click the table operator CHANNELS_IN header.) To determine the operator's bound name, scroll down to the Bound Name properties in the Table Operator Properties panel. This operator is bound to the CHANNELS table in the XSALES schema.

Tip: Alternatively, move your mouse over the header of the operator. If the operator is currently bound, you will see the complete details in the following format: Operator : bound to //module name/operator bound name (for example, Operator CHANNELS_IN: bound to /OWB_DEMO/XSALES/CHANNELS).

Note: Bound name is the physical name of the object that is connected to an object operator in a mapping. Bound names are used to reference the object during code generation.

In the LOAD_CHANNELS mapping, the dimension operator is named CHANNELS_OUT. The operator is bound to the CHANNELS dimension in the SALES_WH target schema.

In the LOAD_CHANNELS mapping, the constant operator is named TOTALS. The Constant operator enables you to define constant values. Constants can be used anywhere in a mapping. The Constant operator produces a single output group that can contain one or more constant attributes. To add a Constant operator on the canvas, you should drag a constant operator from the Palette.

Tip: An example of using a constant operator is to load the value of the current system date into a table operator.

To add the attributes to the TOTALS constant object, right-click the constant operator TOTALS header and selectOpen Details. Click theOutput Attributes tab. Clicking Add will add attributes to the Totals constant object. As you see in the screenshot two attributes have been added.

Click Cancel to close the Constant editor.

In the LOAD_CHANNELS mapping, select the TOT attribute by selecting the TOT attribute in the TOTALS constant operator. On the left in the Mapping Editor, in the Attribute Properties panel, inspect the Expression property. In the Attribute Properties panel, click the field next to the Expression property. Click the button on the right. The Expression Builder is launched. The value of the TOT attribute is "Channels Total." Close the Expression Editor.

In the LOAD_CHANNELS mapping, you see connection lines from:

• Attributes in the table operator CHANNELS_IN to attributes in the dimension operator CHANNELS_OUT
• Attributes in the constant operator TOTALS to attributes in the dimension operator CHANNELS_OUT

In this example, you connect operators by connecting individual operator attributes to each other. Connection lines graphically represent how the data flows from a source, through operators, and to a target.

Close the Mapping Editor.

In the Project Explorer, expand OWB_DEMO. Expand Databases > Oracle > EXPENSE_WH > Mappings. Note that you see a REL_TIME_MAP mapping, which was automatically created by OWB when you created the time dimension REL_TIME using the Time Wizard.

Right-click Mappings and select New.

The Create Mapping window appears.

In the Create Mapping window, enter REL_CATEGORY_MAP as name of the mapping.Click OK.

In the Project Explorer panel, you see an entry for the REL_CATEGORY_MAP mapping under the EXPENSE_WH module. The Mapping Editor launches the REL_CATEGORY_MAP mapping.

From the Palette, drag the Dimension operator to the canvas. The Add Dimension Operator window appears.

In the Add Dimension Operator window, navigate to the EXPENSE_WH module and select theREL_CATEGORY dimension. ClickOK.

The REL_CATEGORY dimension object is dropped on the canvas.

Alternatively, you can add existing sources and targets to a mapping through the Explorer panel, which is on the left side of the Mapping Editor. In the Explorer panel, ensure that Available objects tab is selected. ExpandOracle > EXPENSE_WH > External Tables. Drag EXPENSE_CATEGORIES to the canvas.

Now there are two objects on the canvas, the EXPENSE_CATEGORIES external table and the REL_CATEGORY dimension.

Tip: In the Mapping Editor, click Auto-Layout on the toolbar to change the mapping to its default size. By dragging, move the EXPENSE_CATEGORIES external table to the left of the REL_CATEGORY dimension. Maximize the EXPENSE_CATEGORIES external table by clicking the maximize icon. Similarly, maximize the REL_CATEGORY dimension.

Connect the source (EXPENSE_CATEGORIES external table) to the target (REL_CATEGORY dimension) as follows:

• Drag a connection line from EXPENSE_CATEGORIES.OUTGRP1.EXPENSE_TYPE toREL_CATEGORY.TYPE.NAME

• Drag a connection line from EXPENSE_CATEGORIES.OUTGRP1.EXPENSE_TYPE toREL_CATEGORY.TYPE.DESCRIPTION

• Drag a connection line from EXPENSE_CATEGORIES.OUTGRP1.EXPENSE_CATEGORY toREL_CATEGORY.CATEGORY.NAME

• Drag a connection line from EXPENSE_CATEGORIES.OUTGRP1.EXPENSE_CATEGORY toREL_CATEGORY.CATEGORY.DESCRIPTION

• Drag a connection line from EXPENSE_CATEGORIES.OUTGRP1.EXPENSE_CATEGORY toREL_CATEGORY.TYPE.CATEGORY_NAME.

Tip: Connection lines graphically represent how the data flows from a source, through operators, and to a target.

You have just completed designing the mapping. Now get ready to generate the code for the mapping. In the Mapping Editor, from the menu, selectMapping > Generate. You have now generated the code that loads the dimension. Based on the ETL logic that you design in a mapping, Warehouse Builder generates the code required to implement your design.

The Generation Results window is displayed. The Generation Results window displays the code that has been generated for you.

Close the Mapping Editor.

In the Project Explorer, expand OWB_DEMO. Expand Databases > Oracle > EXPENSE_WH > Mappings.Right-click theMappings node and select New.

The Create Mapping window appears.

In the Create Mapping window, enter REL_EXPENSE_MAP as the name of the mapping.Click OK.

In the Project Explorer you see an entry for the REL_EXPENSE_MAP mapping under the EXPENSE_WH module. The Mapping Editor is launched.

In the Explorer panel, on the left of the Mapping Editor, ensure that the Available objects tab is selected. ExpandOracle > EXPENSE_WH > External Tables. Drag theEXPENSE_DATA external table to the canvas.

The EXPENSE_DATA external table object is on the canvas.

In the Explorer panel, ensure that the Available objects tab is selected. ExpandOracle > EXPENSE_WH > Cubes. Drag theREL_EXPENSE cube to the canvas.

Now, there are two objects on the canvas, the EXPENSE_DATA external table operator and the REL_EXPENSE cube operator.

Tip: In the Mapping Editor, click Auto-Layout on the toolbar to bring the mapping to its default size.

Ensure that the EXPENSE_DATA external table operator is to the left of the REL_EXPENSE cube operator. Maximize the EXPENSE_DATA external table by clicking the maximize icon. In the same way, maximize the REL_EXPENSE cube operator.

In the Mapping Editor, from the Palette panel, drag the Expression operator to the canvas.

In this example, the Expression operator is used to transform the EXPENSE_DATE attribute in the EXPENSE_DATA external table from a date data type to a number data type. The target attribute in the cube is a number data type, therefore, this data type conversion is required to match the data type.

Drag a connection line from EXPENSE_DATA.OUTGRP1.EXPENSE_DATE toEXPRESSION.INGRP1.

Right-click the expression operator EXPRESSION header and select Open Details.

In the Expression Editor, click the Output Attributes tab. ClickAdd.

Rename the OUTPUT1 attribute to EXPENSE_DATE. Ensure that the data type is NUMBER. ClickOK.

In the Mapping Editor, click the expression operator EXPRESSION header, and selectOUTGRP1.EXPENSE_DATE. In the Attribute Properties panel, click the field next to theExpression property. Click the button on the right.

The Expression Builder is launched.

In the Expression Builder, enter the following statement in Expression for EXPRESSION:

TO_NUMBER(TO_CHAR(INGRP1.EXPENSE_DATE , 'YYYYMMDD'), '99999999')

Click OK.

Connect the source operator to the target operator as follows:

• Drag a connection line from EXPRESSION.OUTGRP1.EXPENSE_DATE toREL_EXPENSE.REL_EXPENSE.REL_TIME_DAY_CODE

• Drag a connection line from EXPENSE_DATA.OUTGRP1.EXPENSE_TYPE toREL_EXPENSE.REL_EXPENSE.REL_CATEGORY_NAME

• Drag a connection line from EXPENSE_DATA.OUTGRP1.REIMBURSABLE_AMOUNT toREL_EXPENSE.REL_EXPENSE.EXPENSE

You have just completed designing the mapping. Now you can generate the code for the mapping.

In the Mapping Editor, from the menu, select Mapping > Generate. Warehouse Builder generates the
code required to implement your design. The Generation Results window appears. The Generation Results window displays the code that has been generated for you.

Tip: To view these generated results at a later time, select Generation Results from the Window menu.

From the toolbar, click Save All to commit your work. Close the Mapping Editor.

If not already logged in, log in to the Design Center with username/password asrep_owner/rep_owner.

In the Global Explorer panel, expand the Security node. Right-click theUsers node and selectNew.

Note: You must save or revert your changes before creating a new user. To save previous changes, selectSave All from the Design menu or click on the toolbar.

The Register Warehouse Builder Users Wizard is launched. Click Next on the Welcome page.

On the Select DB user to register page, you can select from the available list of database users or create a new one that will be automatically registered as Warehouse Builder target user.

Select owf_mgr from the Available DB Users list and click > to move it to Selected Users list.

On the Check user as target schema page, de-select the Used as target schemaoption. You need not make OWF user, a target user. ClickNext.

On the Summary page, examine the details and click Finish. The Fix Database Default Role for Users dialog box diaplays.

In the Fix Database Default Role for Users dialog box, enter sys or in SYSDBA Password field in the Fix Now div.

Click OK. Notice that owf_mgr user gets added inside theSecurity > Users node, in the Global Explorer panel.

Before you can start designing the process flow, you need to create a process flow module that includes a process flow package.

Note: Process Flow Modules include Process Flow Packages that include Process Flows. The Process Flow Package is a grouping mechanism that determines which process flows you can interrelate. At run time, you can launch one process flow that launches other Process Flows that exist in the same process flow package.

You create a Process Flow Module named MY_PF_MODULE, Process Flow Package named PK, and a Process Flow MY_PROC. The Process Flow Module acts as a container by which you can validate, generate, and deploy a group of Process Flows.

In the Project Explorer, expand the OWB_DEMO project, and then expand the Process Flows node. Right-click Process Flow Modules and select New from the menu.

The Create Module Wizard is launched. Click Next on the Welcome page.

On the Name and Description page, enter MY_PF_MODULE as the name of the process flow module. ClickNext.

Now you create an Oracle Workflow location for the process flow module, MY_PF_MODULE.

Note: You define an Oracle Workflow location to specify where you want to deploy your process flows. The Oracle Workflow location points to a workflow schema (OWF_MGR) that runs in the target database. Warehouse Builder process flows comply with the XML Process Definition Language (XPDL). When you generate a process flow, Warehouse Builder generates an XML file in the XPDL format. You can plug the generated XML file into any workflow engine that follows the XPDL standard.

On the Connection Information page, observe that Warehouse Builder creates a location with a default name, MY_PF_MODULE_LOCATION1. ClickEdit to specify the details of the Workflow location.

In the Edit Oracle Workflow Location window, change the name of the location toWH_OWF_LOCATION. Specify the connection details to the Oracle Workflow schema. This course uses owf_mgr as the schema name and owf_mgr as the password. If your Oracle Workflow schema has a different name and password, substitute accordingly.

Password: owf_mgr
Host: localhost
Port: 1521
Service: orcl
Schema: owf_mgr
Version: 2.6.3

Note: If you are using Oracle Workflow 2.6.4, select the appropriate version.

Click Test Connection. If the connection is successful, clickOK. If the connection is not successful, check the connection details and try again.

Click OK. Click Next. On the Summary page, review the details and clickFinish.

In the Create Process Flow Package window, specify PK as the name and clickOK.

The Create Process Flow window is launched. Specify LOAD_EXPENSE_WH as the name of the process flow.

Warehouse Builder launches the Process Editor and displays the process flow with a Start activity and an End_Success activity. You now learn how to design the process flow with activities and transitions.

In the Process Editor, from the Palette panel, drag the Fork activity to the canvas. You can use the Fork activity to launch multiple, concurrent activities after the completion of an activity. You can also drag the Fork activity from the Selected Objects tab in the Explorer panel.

In the Process Editor, in the Explorer panel, click the Available Objectstab. From the EXPENSE_WH target module, dragREL_CATEGORY_MAP mapping to the canvas.

In the Explorer panel, ensure that the Available Objects tab is selected. Drag theREL_TIME_MAP mapping to the canvas.

On the canvas, you see two mapping activities, REL_TIME_MAP and REL_CATEGORY_MAP. Rearrange the mapping activities vertically just to the right of the START activity.

Note: On dropping the mapping activities on the canvas, if you get "Unable to determine if the map is a PLSQL or SQLLDR map........" error, then in the Design Center, right-click the appropriate mapping and selectConfigure. In the Configuration Properties window, for Language property, selectPL/SQL.

From the Palette panel, drag an AND activity to the canvas, to the right of the REL_TIME_MAP and REL_CATEGORY_MAP mapping activity.

In the Explorer panel, ensure that the Available Objects tab is selected. Drag theREL_EXPENSE_MAP mapping activity to the canvas.

Rearrange the REL_EXPENSE_MAP to the right of the AND Activity.

From the Palette panel, drag an END with ERRORS activity to the canvas. Drag it to the right of the REL_EXPENSE_MAP cube mapping and above the END_SUCCESS activity.

From the Palette panel, drag an END with WARNINGS activity to the canvas. Drag it to the right of the REL_EXPENSE_MAP mapping activity and below the END_SUCCESS activity. The process appears as shown in the screenshot.

Now you learn how to connect the activities.

Position your cursor on the Start activity. Ensure the cursor changes to ( ). Drag a line (these lines will from here on be referred to as transitions) from Start activity to the Fork activity.

Note: Use transitions to indicate the sequence and conditions in which activities occur in the process flow. You can use transitions to execute an activity based on the completion state of the preceding activity.

To drag a transition, the mouse pointer must change to ().

• Drag a transition from FORK activity to the mapping activity REL_CATEGORY_MAP.

• Drag a transition from FORK activity to the mapping activity REL_TIME_MAP.

• Drag a transition from mapping activity REL_CATEGORY_MAP to theAND1 activity.

• Drag a transition from mapping activity REL_TIME_MAP to the AND1 activity.

• Drag a transition from AND1 activity to the mapping activity REL_EXPENSE_MAP.

• Drag a transition from mapping activity REL_EXPENSE_MAP to END_ERROR activity.

• Drag a transition from mapping activity REL_EXPENSE_MAP to END_SUCCESS activity.

• Drag a transition from mapping activity REL_EXPENSE_MAP to END_WARNING activity.

After having linked all the activities with transitions, the process flow will look as shown in the screenshot.

Transitions that you learned and added in the above steps are unconditional transitions. By default, transitions are unconditional. The process flow continues after the preceding activity completes, regardless of the ending state of the previous activity.

Note: You may get some invalid characters, such as <0> and <1>, as you drag transitions from one activity to another. You can ignore them as it does not cause any issues during deployment or execution.

You can use transitions to execute an activity based on the completion state of the preceding activity. Now, you learn to apply conditions to transitions.

Select the transition from the REL_EXPENSE_MAP mapping activity to the END_SUCCESS activity. In the Object Details panel, the transition is named Transition_6 as seen in the screenshot. The transition name you see in your working environment can be different from what you see in the screenshot. The name difference does not matter.

Ensure that the transition (the line) between the REL_EXPENSE_MAP mapping activity and END_SUCCESS is selected.

In the Object Details panel, click in the field next to the Condition property. Click the button on the right. The Transition Condition Editor is displayed. In the Transition Condition Editor, select theEnumerated Condition option button. From the drop-down list, selectSUCCESS. ClickOK.

Select the transition between the REL_EXPENSE_MAP mapping activity to the END_ERROR activity. The transition named Transition_6 is highlighted.

In the Object Details panel, click the field next to property Condition. Click the button. The Transition Condition Editor is displayed. In the Transition Condition Editor, select theEnumerated Condition option button. From the drop-down list, selectERROR. ClickOK.

This indicates that the process flow continues if the preceding activity (REL_EXPENSE_MAP) ends in an error.

Select the transition between the REL_EXPENSE_MAP mapping activity to the END_WARNING activity.

In the Object Details panel, click in the field next to the Condition property. Click the button. In the Transition Condition Editor, select theEnumerated Condition option button. From the drop-down list, selectWARNING. ClickOK.

This indicates that the process flow continues if the preceding activity (REL_EXPENSE_MAP) ends with warnings.

This completes the design of this process flow. Generate the LOAD_EXPENSE_WH process flow by selectingGenerate from theProcess Flow menu.The code generated from a process flow definition is in industry standard XML Process Definition Language (XPDL).

From Process Flow menu, select Close to exit the process editor.

In the Design Center, click Save All on the toolbar to commit your work.

These steps are read-only, not to be performed.

Assumptions: The REL_CATEGORY dimension has been deployed to the target schema. The EXPENSE_CATEGORIES external table is not deployed. You will debug the REL_CATEGORY_MAP mapping.

Expand OWB_DEMO, expand Databases, expand EXPENSE_WH, and double-clickREL_CATEGORY_MAP.

The REL_CATEGORY_MAP mapping opens in the Mapping Editor. Maximize the window.

Warehouse Builder provides debugging capabilities for data flows within the Mapping Editor. Debugging functions are available on the toolbar and the Debug menu.

Start the debug session by clicking Debug S