You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When using DeprecatedOutputFormatWrapper with PartitionTap, the output won't be committed to the final location but discarded in the temporary directory.
There are two issues here:
TapOutputCollector used by PartitionTag is testing if the output format is a FileOutputFormat or not, after wrapped, it's not a FileOutputFormat anymore, the filenames won't be created.
The commit never happen when used in this case, the test for commit will always return false, since the real output format is writing to a different temp dir, and no intermedium commit to bridge them up.
The text was updated successfully, but these errors were encountered:
When using DeprecatedOutputFormatWrapper with PartitionTap, the output won't be committed to the final location but discarded in the temporary directory.
There are two issues here:
The text was updated successfully, but these errors were encountered: