All Questions
664
questions
0
votes
0
answers
21
views
Pythonic parallelized streaming of batches (list-of-dicts) of JSON into a single file write
I have a multiprocessing thread pool where each job returns a requested batch of JSON (an array of objects). I want all results to write into a single file, but without storing the full result (as a ...
- 889
1
vote
3
answers
71
views
How to peek the n-th char in stream reader c#
I am making a custom input reader for a parser in C#, and I am trying to peek the n-th character from a stream reader without moving the streams position, so that when the function is called multiple ...
user25451410
1
vote
1
answer
105
views
File uploads get corrupted when reading a POST request body
I'm building an android app that needs to receive a file from a web application.
I'm using Java ServerSocket to deal with that.
I handled the POST request headers and all works fine but when I write ...
- 195
0
votes
1
answer
53
views
Reading huge JSON array to get specific item
I have a huge JSON file where the top level structure is an array, and it basically contains many subarrays like this: [ [], [], [], ... [] ]
Each subarray is actually quite small so it is loadable ...
- 708
0
votes
0
answers
46
views
how to implement custom BinaryIO wrappable in TextIOWrapper?
I have a stream that I can read packets of bytes from. I want to be able to use file operations on that stream like shutil.copyfileobj and be able to wrap it around io.FileIOWrapper.
I wrote the ...
- 135k
0
votes
1
answer
89
views
Writing bytes in client less than expected [closed]
I'm trying to use a UDP socket in C++ to send data between a client and server as a project in my university. The file I'm trying to send is an HTML document called s.html. It's 1,814,247 bytes in ...
1
vote
1
answer
571
views
Nest js Downloading file to s3 through my API is extremely slow
I'm utilizing my Nest API to upload files to S3, which is functioning smoothly. However, I'm encountering a slowdown when attempting to download files through my API. Are there any recommendations on ...
- 116
-1
votes
1
answer
125
views
Using a file PATH with a colon in Windows file system
What does the colon in the PATH (for example "a:data.dat") mean in Windows file system.
In the following C++ code:
ofstream outfile;
outfile.open("a:data.dat");
I'm using Windows ...
2
votes
1
answer
197
views
Creating a virtual file on disk
I have an external program (as an executable binary) that consumes input files that potentially could be very large. I'm writing a C# application that will take data from our DB; write a segment of it ...
- 1,070
0
votes
1
answer
75
views
Converting decompression stream to a regular stream
let decipher = crypto.createDecipheriv(type, file.metadata?.key, file.metadata?.iv)
let decompress = new fflate.Decompress()
let decipherStream = fs.createReadStream(location).pipe(decipher)
...
3
votes
1
answer
73
views
What is the canon/standard name for file handle/stream/file stream of Lua?
I noticed that the thing that is returned by io.open() is called differently. I wonder what the canon name is.
in Lua 5.4 Reference Manual, it's called a "file handle".
in "Programming ...
- 33
1
vote
0
answers
59
views
Nodejs backpressure for createGunzip
Here is my problem I'm trying to read a zipped file and do some async stuff with the data without fully reading the file's content into memory, but as soon as I do some async stuff the backpressure ...
- 236
1
vote
1
answer
503
views
How to close input or output stream when using Kotlin File's extensions
Do we need to close input or output stream when we use Kotlin's File.readText or File.writeText extensions
file.readText()
file.writeText("something")
- 1,521
1
vote
3
answers
141
views
Stream the output of a void function using printf()
I want to store the output of a function (matrix_output_printf()) printing the following output (a matrix):
0 1 2
1 2 3
2 3 4
I would like to save this output in a text file.
In ...
- 5,361
0
votes
0
answers
76
views
Writing file with <fstream>/FILE in C/C++
I am a bit perplexed by the way FILE/fstream systems described in C/C++. For instance, I want to write a file which I know the size of beforehand, just like any image (for instance tga with 18 bytes ...
- 67