We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
`$ hadoop jar target/filecrush-2.2.2-SNAPSHOT.jar com.m6d.filecrush.crush.Crush --info --verbose --threshold=0.1 --compress=gzip /user/arustamov/crush{17,18} $(date +%Y%m%d%H%M%S) outDir is: tmp/crush-a7ea6dac-c48a-483f-a652-1be09b8cfaff/out
Using temporary directory tmp/crush-a7ea6dac-c48a-483f-a652-1be09b8cfaff16/07/01 09:56:51 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library 16/07/01 09:56:51 INFO compress.CodecPool: Got brand-new compressor [.deflate] 16/07/01 09:56:51 INFO Configuration.deprecation: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
/user/arustamov/crush17 has no crushable files
Skipped 2 files /user/arustamov/crush17/part-00402 /user/arustamov/crush17/part-00397
/user/arustamov/crush17/subdir has no crushable files
Skipped 1 files /user/arustamov/crush17/subdir/part-00401
Copying crush files to /user/arustamov/crush18
Moving skipped files to /user/arustamov/crush18 /user/arustamov/crush17/subdir/part-00401 => /user/arustamov/crush18/subdir/part-00401 /user/arustamov/crush17/part-00402 => /user/arustamov/crush18/part-00402 /user/arustamov/crush17/part-00397 => /user/arustamov/crush18/part-00397
Deleting temporary directory `
The text was updated successfully, but these errors were encountered:
output is uncomprssed files of the same size as input
Sorry, something went wrong.
No branches or pull requests
`$ hadoop jar target/filecrush-2.2.2-SNAPSHOT.jar com.m6d.filecrush.crush.Crush --info --verbose --threshold=0.1 --compress=gzip /user/arustamov/crush{17,18} $(date +%Y%m%d%H%M%S)
outDir is:
tmp/crush-a7ea6dac-c48a-483f-a652-1be09b8cfaff/out
Using temporary directory tmp/crush-a7ea6dac-c48a-483f-a652-1be09b8cfaff16/07/01 09:56:51 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library
16/07/01 09:56:51 INFO compress.CodecPool: Got brand-new compressor [.deflate]
16/07/01 09:56:51 INFO Configuration.deprecation: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
/user/arustamov/crush17 has no crushable files
Skipped 2 files
/user/arustamov/crush17/part-00402
/user/arustamov/crush17/part-00397
/user/arustamov/crush17/subdir has no crushable files
Skipped 1 files
/user/arustamov/crush17/subdir/part-00401
Copying crush files to /user/arustamov/crush18
Moving skipped files to /user/arustamov/crush18
/user/arustamov/crush17/subdir/part-00401 => /user/arustamov/crush18/subdir/part-00401
/user/arustamov/crush17/part-00402 => /user/arustamov/crush18/part-00402
/user/arustamov/crush17/part-00397 => /user/arustamov/crush18/part-00397
Deleting temporary directory
`
The text was updated successfully, but these errors were encountered: