Proof Of Concept - Automation In Informatica Code Migration

Automation In Informatica Code Migration

Author : Shivakumar Krishnagouda Patil

Description :

This mini project has been taken up as an initiative , in the view of eradicating the duplication effort involved in Informatica Infrastructure Support projects and also to decrease the project costing by reducing the number resources (Administrators) who are carrying out the duplication effort. This reusable component reduces the half of time involved in carrying out the specified activity compared to the traditional manual effort so that we can deliver the work to the business within a short span of time. This component confirms  accurate work of productivity. User wait time can be reduced as most of the user waits when their work to be done.
Features of automated deployment groups

1.Automated migrations.
2.Reduction of admin resources.
3. Automated backup system.
4.Automated recovery.(In case of version control).
5.Faster code move.
6.Less effort investment.
7.No manual intervention.
8.Automated sanity checks.
9.Automated alerting in case of migration failures.
10.Time saving.
11.Bulk amount of objects can be migrated in a single shot. Which is a kind of reusable component
12.Migration logs can be captured for analysis.
13.The same deployment workflow, scripts can re-used in many environments for migrations.
Automated deployment groups

Tech Stack Used :

Tool : Informatica 9.1 (Hot Fix 4)
Database : Oracle 11g (Repository Schema Versionised)
Operating System : Linux RedHat (x86_64-Bit OS)

Scripting Used :

Shell Scripting (ksh)
Structured Query Language (sql)

Testing Used :

Unit Testing :

Each of the scripts have been tested separately in order to verify the functionality of each of it.

Regression Testing:

Informatica workflows has been ran in different intervals of time to ensure whether the
scripts used in workflow would adversely affect Informatica Infrastructure.
Advantages of automated deployment groups
  •  User wait time can be reduced as most of the user waits when their code can be moved to target environment.
  •  Effective use of automated deployment groups add value to the project and reduces the cost .
  •  Ensures to business that accurate work of migrations.
  •  Admin resources can be reduced where multiple admins used to do the multiple migrations where as in automated deployment a single admin can handle multiple migrations. (In traditional system 5 admins used to do the migration a single admin resource can handle with the help of automated deployment group)
  •  Infa admin burden can be reduced – where in In traditional migration activity admin used to select the individual objects (check in /check out) and to migrate, which was very time consuming through a repository manager ,but with automated scripts it’s a piece of cake all the objects will be added in a single shot.
  •  XML backup of the objects will be taken automatically by the script and which will send as an email with an attachment.
  •  Automated deployment job can be scheduled to respective timings.
          Advantages of automated deployment groups
  •  Admins will not be having any confusion as compared to normal traditional migrations –
  •  which objects are missed and which objects needs to be validated everything will be taken care by scripts.
  •  Once the Objects are migrated , script will be sending the email with time-stamp of the objects  migrated as a part of sanity check.
  •  Automated deployment groups reduces the un-necessary duplication works.
  •  In upgrade process huge amount of informatica folders can be migrated from one environment to other environment within a short span of time with the help of this automated deployment groups.
  •  In this automation poc only few scripts are developed and those are re-used based on the requirement by passing the parameters . For Ex : object_export.ksh script which is developed only once and can be called three times for exporting the different informatica objects Mappings, Sessions, Workflows.
  •  Scripts will take care of creating the deployment group, adding the objects to group and migrating the objects and once migration completes group will be automatically deleted.
Deployment groups overview :

Normally you know only

•  Static deployment groups
•  Dynamic deployment groups

 But here is the automated deployment group:

Informatica Admin will be just responsible to

•  Review the .csv spread sheet given by the user and
•  Place the spread sheet to Informatica server source file path
•  Schedule the deployment load
•  Manage the deployment scripts
•  High level sanity checks whether everything went smooth

60 comments:

  1. You provided the advantages., But can i get the solution please

    ReplyDelete
  2. please post the scripts asap

    ReplyDelete
  3. Hi Haleem -

    Yeah Sure...

    Many Thanks

    Shivakumar

    ReplyDelete
  4. Hi ShivKumar,

    When should we get those posts, Could you please let us know the time.
    Thanks

    ReplyDelete
  5. Ratna -

    soon will get it.

    Many Thanks

    Shivakumar

    ReplyDelete
  6. Using query, entire all objects can be exported,right. Why do we need to export mappings,sessions and workflows seperately?. What is automated deployment group?

    ReplyDelete
  7. Dear Venkat-

    First question comes here why you want to export all the objects ?
    Here only the objects requested to be migrated needs to be exported not all the objects
    Automated deployment group migrates the objects without any human intervention.
    Please go through the article completely.

    Many Thanks

    Shivakumar

    ReplyDelete
  8. Hi Shiva, have you shared the script yet ? can you please share the same and also how to execute in order to test the functionality ?

    ReplyDelete
  9. Hi Swarnalli -

    Sure ..will do that.I built the scripts and embedded in to informatica workflow which has been scheduled to run.
    I did put this POC in to informatica portal idea section. I didn't hear back anything from them once I hear back I will upload here.

    Many Thanks

    Shivakumar

    ReplyDelete
  10. Thanks much Siva, this is really great to hear your response, will be waiting for your update. Can you please share your email ID , I've few ideas related to informatica automation, wanted to share and discuss with you. Also if you've any reading materials for Informatica 9 certification could you please share. I would like to take that certification program.

    ReplyDelete
  11. Hey Siva,

    Your POC will be really useful in my project. As of now we are doing all the migrations manually from one instance to other. If you can please e-mail this script to sm21474@gmail.com it would be really helpful.

    Thanks

    ReplyDelete
  12. Siva,
    Would also appreciate if you coud email the scripts to tienda123@gmail.ocm

    ReplyDelete
  13. hi ,
    Can u email me the script waseem.siddiqui@aol.in

    ReplyDelete
  14. Siva,

    Could you please send the script to hari1352@yahoo.com

    Thanks
    Hari Manne

    ReplyDelete
  15. Hi Siva,
    We are too migrating the code manually. Can you pls fwd me the scripts at bhaumikcrespo@yahoo.co.in

    TIA
    Bhaumik

    ReplyDelete
  16. Hi Siva,

    Can you please send me the scripts to jpdadi@yahoo.com.

    Thanks
    Jay

    ReplyDelete
  17. Where can i get the script

    ReplyDelete
  18. Please,send me also the scripts.

    ReplyDelete
  19. can you post the scripts ASAP

    ReplyDelete
  20. can you send us the scripts to my e-mail id: rk999e@gmail.com

    ReplyDelete
  21. Really helpful..

    please send the scripts to ashutoshkaushik86@gmail.com.

    ReplyDelete
  22. Hi Shiva,

    Please send the scripts to msreddy85@gmail.com

    ReplyDelete
  23. Hi

    Can you please send the scripts to bharath.rbr@gmail.com

    ReplyDelete
  24. Hi
    Can you please send the scripts to venki81in@gmail.com

    ReplyDelete
  25. Can you please pass me the scripts to my email-id : northshields_uk@hotmail.co.uk
    many Thanks in advance .... cheers mite ...

    ReplyDelete
  26. Can any one email me the script vjnimmagadda6@gmail.com.

    ReplyDelete
  27. Hi,
    Can you please mail the scripts to pratheeshvarnan@gmail.com

    ReplyDelete
  28. can you send me the scripts to venkat_tn@rediffmail.com

    ReplyDelete
  29. Can you send me the scripts to herryjwong@gmail.com

    ReplyDelete
  30. can you send me the scripts to balagj709@gmail.com

    ReplyDelete
  31. Hi Siva, Request you to send me the scripts to mail.nithyaj@gmail.com

    ReplyDelete
  32. Hi Siva, we are trying to explore informatica version control, can you please email me the script to vijayasundar03@gmail.com

    ReplyDelete
  33. Nice... can you share scripts... akumar.klp@gmail.com

    ReplyDelete
  34. Hi All,

    Have you guys received the scripts?. if Yes, Could you please forward the scripts to the mentioned e-mail id : Mohiddin8@yahoo.com

    Appreciate your help.

    Regards,
    Mohiddin.

    ReplyDelete
  35. Can you please also email the scripts to melbaswapna@gmail.com

    ReplyDelete
  36. Hello i have not got any reply from this blog. Will anyone be able to help me out with the scripts. If anyone has it can you please email the automation scripts to melbaswapna@gmail.com. Thank you in advance, Melba

    ReplyDelete
  37. Shivakumar Krishnagouda PatilJanuary 10, 2014 at 9:34 AM

    blog articles has been shifted to you can post your comments over there.

    ReplyDelete
  38. Hi,

    Does anyone have the scripts, can you please email me malka.pavan@gmail.com
    I am working on Deployment groups and wanted to automate it.

    Thanks
    Pavan

    ReplyDelete
  39. From Raju... Hi Shiva.. Very helpful. Could u plz send those latest scripts to my email v4chiru@gmail.com

    Thanks for your quick help here.

    ReplyDelete
    Replies
    1. Shiva,.. Still I didn't get this script... can u send to v4chiru@gmail.com

      Delete
  40. Hi,

    Does anyone have the scripts, can you please email me tejes.br@gmail.com
    I am working on towards automation of informatica health check post deploymennt.

    Thanks
    Tejesh

    ReplyDelete
  41. Siva, can you upload the scripts for this POC now? they seem to be really useful.

    ReplyDelete
  42. Shiva,

    Are you using contol files to resolve to conflict issue while informatica migration, please can you share the scripts or upload the scipts to your blog. we are in the process of Deploy automation, it would be great if you can upload the scripts or you can send scripts to nanda_doc@yahoo.com

    Thanks

    ReplyDelete
  43. Shiva,

    Could you please share the scripts to adusumallisr.dwh@gmail.com

    If anyone has scripts pls share to the above mail id.

    Thanks,
    Subba

    ReplyDelete
  44. Hi Is this solution available with anyone?

    ReplyDelete
  45. Shiva,
    Can you share the automated scripts for deployment to sh.kamarajugadda@gmail.com

    Thanks,

    ReplyDelete
  46. hi shiva,

    could you please share the code migration automation scripts to my mail id mahesh0308.dwh@gmail.com

    thanks
    mahesh

    ReplyDelete
  47. Shiva,
    Can you share the automated scripts for deployment to magunta@gmail.com

    ReplyDelete
  48. Hi Shiva,

    Could you share the shell and sql scripts to schandru.info@gmail.com

    Thanks!

    ReplyDelete
  49. Hi Kumar,
    Please could you share the shell and sql scripts to ndasijulius@gmail.com
    Thanks

    ReplyDelete
  50. Can you please send the script to ur.sourish@gmail.com

    ReplyDelete
  51. Can you please send the script to patilkajal11@gmail.com

    ReplyDelete
  52. can you please send me at tapas.sinha@yhaoo.co.in

    ReplyDelete
  53. Please send me at katta.sunil@gmail.com

    ReplyDelete
  54. Can you please give the script to swami2sai@gmail.com

    ReplyDelete

Featured Post

Cloud : A Trendsetter Technology