Questions tagged [xz]
xz is a lossless data compression program and file format which incorporates the LZMA/LZMA2 compression algorithms
112
questions
0
votes
1
answer
69
views
Windows equivalent of specific LINUX compression tool
In LINUX there is this very specific compression utility/tool at /usr/bin/xz.
Now I am on Windows 10 x64 running PHP 8.1 and I have a php library, that in one line of its code call this very specific ...
- 23
0
votes
0
answers
49
views
I wanted decompress .xz file in cpp using lzma in chunks i.e decompress some data and the read in async fashion
I am doing this using lzma strm decoder and maintain position variable till we have read the file and using seekg(postion) before decoding but
when second time function is called but I am receiving ...
0
votes
1
answer
158
views
Clarification on Impact of XZ Utility Vulnerability on Code Dependencies ( Scala/Akka )
I’ve heard about a critical vulnerability found in SSH servers, particularly affecting XZ utility versions 5.6.0 and 5.6.1, as well as the liblzma library. This vulnerability is tracked under CVE-2024-...
- 81
0
votes
1
answer
38
views
How to use XZ / liblxma-dev to compress data using LZMA_FILTER_LZMA1 filters
I'm trying to use liblzma to compress data using lzma1, but I'm having an issue where lzma_stream_encoder returns LZMA_PROG_ERROR before I get a chance.
I've tried modifying options and swapping in ...
- 1
0
votes
0
answers
18
views
Cleanest way skip bytes in .RAW image file
I have a .RAW image file. I need to skip the first $SKIP_BLOCKS bytes which correspond to the MBR.
I previously had the file in compressed format and would do the following
xz -d -c $...
- 2,287
0
votes
1
answer
224
views
Where in the .XZ file is stored uncompressed file size?
I read XZ's specification and I want to get uncompressed size. There is nothing like this in the footer or header.
Am I supposed to:
read "Backward Size" from the header
calculate:
...
- 3,004
0
votes
1
answer
219
views
How to use Packer with xz images
I'm following this (rather old) article about building a Raspberry Pi image using Packer:
https://linuxhit.com/build-a-raspberry-pi-image-packer-packer-builder-arm/
The process works great except that ...
- 3,761
1
vote
1
answer
908
views
"liblzma library and headers are required" when installing R-4.2.2 and dependencies under $HOME
I am installing R-4.2.2 under my $HOME path on a Red Hat 4.8.5-28 server.
When I run ./configure --prefix=$HOME/R --enable-R-shlib I found the error:
checking whether bzip2 support suffices... yes
...
- 25
3
votes
0
answers
241
views
Removing null bytes from a file results in larger output after XZ compression
I am developing a custom file format consisting of a large number of integers. I'm using XZ to compress the data as it has the best compression ratio of all compression algorithms I've tested.
All ...
- 85
0
votes
1
answer
331
views
How to Extract tar.xz with password on Google colab?
I have a tar.xz file.
So far I have seen many file extractions but not with tar.xz files with passwords.
Please, thank you for your help.
3
votes
3
answers
2k
views
tar.xz - how to check uncompressed files size without decompress whole archive
I have a problem with checking uncompressed size from archive tar.xz without extract whole archive.
I know that for tar.gz I can use gzip or zcat but for tar.xz it dosnt work.
Any sugestion how to do ...
- 47
1
vote
2
answers
781
views
How to do random access of specific blocks in an .xz file?
My goal is to be able to reduce time needed to look at specific sections from the middle of very large log files compressed to .xz format.
If the .xz files are for example 6GB compressed and 60GB ...
- 61
0
votes
2
answers
413
views
Determining Anaconda XZ Package Content
I'm currently trying to figure out the contents of an anaconda package called XZ.
From my understanding, the package provides binding for XZ Utils (data compression tool).
I'm trying to figure out the ...
- 1
1
vote
0
answers
1k
views
unzip xz file into memory and read csv with pandas
I have a zipped file which contains a csv, compressed with xz. I want to unzip it into the memory, and read wit pandas' read_csv method.
Pandas knows xz compression
data = pd.read_csv(...
- 117
1
vote
1
answer
2k
views
Python 3.8 lzma decompress huge file incremental input and output
I am looking to do, in Python 3.8, the equivalent of:
xz --decompress --stdout < hugefile.xz > hugefile.out
where neither the input nor output might fit well in memory.
As I read the ...
