DTS / DMO

I'd like to load a few huge CVS files to an MSSQL server.
I don't want to create temporary files, instead I want to read the CVS
file from the disk line by line and after transforming it I'd send it to
the database.
Formerly I used INSERTs, but they seemed very slow.
BULK INSERTs don't work either, because the file format cannot be parsed
with bcp.
Now I'm considering using DTS or DMO, but I don't know which of them
fits my needs better. And which of them is the easier to learn and work
with from C#.
I'd be greatful for any example, or comment on using these tools.
Thanks in advance,
Gabor GludovatzDTS is definatley the way to go to here. You can use it to do
transforms if the CSV format needs to be massaged in anyway. You can
also dynamically adjust the columns that might need to be imported if
you have different file formats.
Gabor Gludovatz wrote:
> I'd like to load a few huge CVS files to an MSSQL server.
> I don't want to create temporary files, instead I want to read the CVS
> file from the disk line by line and after transforming it I'd send it to
> the database.
> Formerly I used INSERTs, but they seemed very slow.
> BULK INSERTs don't work either, because the file format cannot be parsed
> with bcp.
> Now I'm considering using DTS or DMO, but I don't know which of them
> fits my needs better. And which of them is the easier to learn and work
> with from C#.
> I'd be greatful for any example, or comment on using these tools.
> Thanks in advance,
> Gabor Gludovatz
>