Should IsSorted metadata be stored in raw files

Jamie Thomson

Hello,

I have an input into a raw file destination that has IsSorted=TRUE.

Any output from a raw file source that uses that raw file will have IsSorted=FALSE.

 

So, a question for Microsoft. Is it a legitimate request to ask that the IsSorted and SortKey metadata be stored in a raw file If so I shall raise it at Connect.

-Jamie

 

Phil Brammer


Ah, raise it anyway! Best way to get visibility to it.

Jamie Thomson

Phil Brammer wrote:

Ah, raise it anyway! Best way to get visibility to it.

OK. Done.

https://connect.microsoft.com/SQLServer/feedback/ViewFeedback.aspx FeedbackID=242351

-Jamie

Jeff Bernhardt

hmm. must have missed those.

not that it helps you too much Jamie, but the IsSorted metadata was added to the pipeline late in development, after the raw files (and the tests for the raw files) were written.

as a workaround, you should be able to explicity set the IsSorted flags on the columns in the raw file source. This means that the metadata needs to be stored in your head instead of in the file, but it might help.

Jamie Thomson

Hiya Jeff,

Jeff Bernhardt wrote:

hmm. must have missed those. not that it helps you too much Jamie, but the IsSorted metadata was added to the pipeline late in development, after the raw files (and the tests for the raw files) were written.

Fair enough!

Jeff Bernhardt wrote:

as a workaround, you should be able to explicity set the IsSorted flags on the columns in the raw file source. This means that the metadata needs to be stored in your head instead of in the file, but it might help.

Yep, that's exactly what I've done.

It sounds like you think this is a legitmate thing to ask for then. Is that fair (I won't put pressure on you and ask if we'll get it in katmai )

-Jamie

[SSIS Team Followup]

Matt Masson - MSFT

Hi Jaime,

This is still an open issue, and is currently in the Katmai bucket o' improvements. There's still a chance it won't make it into the initial release since it hasn't been targetted yet, but it's one of the higher priority issues on the list.

~Matt

Jamie Thomson

Matt Masson - MSFT wrote:

Hi Jaime, This is still an open issue, and is currently in the Katmai bucket o' improvements. There's still a chance it won't make it into the initial release since it hasn't been targetted yet, but it's one of the higher priority issues on the list. ~Matt

Good news. Thanks Matt.

-Jamie