Issues with working in Flat Files

Informatica is a ETL tool and you need to have the source data on which you can perform the ETL process. Now, this source can be either flat file or a SQL file. But with flat file there are some issues. Let us have a look at some of them. Also, if you are preparing for an interview, it is one of the questions you are likely to be asked.

 
What are some of the issues while working with flat files as a source in Informatica?
Flat files bring along with them the following issues –

    • We require transformations for all the operations and cannot use the SQL override when using flat files
    • Testing flat files is a very tedious task
    • It is very important to specify the correct path for the source file in the session and also specify whether it is direct or indirect
    • You need to also make sure that the file in informatica is in complete synchronization with the actual file.
    • Even more there are some data type issues, like date in flat files is stored in string but in SQL you need to convert it into date/time
    • Also, mapping is not an easy task. So, for example, if you missed out on some column while mapping, all of the data will get shuffled up or you will end up having empty data.

Happy Learning 🙂



Leave a comment