Geeks With Blogs
Rahul Anand's Blog If my mind can conceive it, and my heart can believe it, I know I can achieve it. ETL Related to data loading concepts
Internal.Job.Filename.Directory in Kettle
From last few days I was wondering why this internal variable (Internal.Job.Filename.Dire... is always empty in my development environment. The documentation at says these variable will be always defined. But it was not in my case. After lot of time spent debugging and breaking my head I found that these variables are set only if you do not use the repository. In my case I was using a file based repository which was causing this issue. By disconnecting ......

Posted On Friday, February 8, 2013 9:44 AM

Pentaho Data Integration (Kettle)–Continuous processing by implementing a loop
Many articles on implementing a loop in PDI suggest to put a ‘Wait For’ step and join the output hop back to a previous step. Something as suggested by below screen shot: But I would like to warn about this implementation of looping that this causes recursive stack allocation by JVM during job execution and the system may run out of memory after a high number of iterations (depending the system available available memory). In a test run on my laptop in which I continuously ran the above job with ......

Posted On Friday, February 8, 2013 7:45 AM

My introduction to Pentaho Data Integration – Kettle (ETL Tool)
Context: Recently I got a chance to get introduced to Kettle, due to a new project which requires ingesting huge and dynamic data files using PDI in a data warehouse. I have a good experience working with Microsoft technology stack - .NET Framework, C#, SQL Server, SSIS. The idea of open source has always been fascinating to me but I have not worked much with open source tools. So, working with PDI is quite a different experience for me. I liked the continuous evolution of PDI and the capabilities ......

Posted On Wednesday, February 6, 2013 12:23 PM

Copyright © Rahul Anand | Powered by: