All Questions
298
questions
1
vote
1
answer
32
views
System.Text.Json.JsonSerializer does not overwrite existing file fully when using file stream
Consider the following code:
internal class Program
{
static async Task Main(string[] args)
{
var t = new Thing() { Name = "Some Long Name" };
string path = @"c:\...
- 34.8k
0
votes
0
answers
21
views
Pythonic parallelized streaming of batches (list-of-dicts) of JSON into a single file write
I have a multiprocessing thread pool where each job returns a requested batch of JSON (an array of objects). I want all results to write into a single file, but without storing the full result (as a ...
- 889
0
votes
1
answer
29
views
In NodeJS data is not receiving as chunks (stream) in consumer
I having a two services producer and consumer.
Producer has big json file in the server. I want to serve over the network through rest api and I used nodejs stream technique to load bytes in memory ...
0
votes
2
answers
104
views
Treat parsed JSON as HTML instead of text (edited)
Consider this simple code below
When I parse the content and get the "txt" with JSON.parse(e.data).choices[0].delta.content; then it works fine if it is plain text. However, there are some ...
- 3
0
votes
1
answer
53
views
Reading huge JSON array to get specific item
I have a huge JSON file where the top level structure is an array, and it basically contains many subarrays like this: [ [], [], [], ... [] ]
Each subarray is actually quite small so it is loadable ...
- 708
0
votes
0
answers
72
views
Parsing items using JSON Stream
I am quite new to the concept of streams in Node js. I am using the JSONStream package in node to parse an api response. The response is an array of javascript objects and is being streamed from the ...
- 1
1
vote
0
answers
50
views
Read the DB using stream in android ROOM
I have an android app to read room database and export it to json.
It spend memory very much. I just wanna use stream or any other solution so that it doesn't need to load entire data in memory.
...
- 147
1
vote
0
answers
283
views
How do i serialize a excel file stream?
I need to convert the Excel file into a stream with XLWorkbook (using ClosedXML.Excel) and then serialize with JSON format (Newtonsoft.Json) but a code error appears.
I already have a excel file saved ...
- 11
0
votes
1
answer
87
views
jq: Using stream and not
This is likely a shamefully simple problem, but I cannot figure it out. I am trying to use this question to extract some data using the --stream option of jq. Here is my sample json:
{
"date&...
- 105
0
votes
3
answers
181
views
Get the first JSON object from a file containing a sequence of JSON objects [duplicate]
I have a file containing a sequence of json objects. Using the jq tool, how can I get the first json object from that file?
I have tried jq limit(1; .) input.jsonl but that limits the length of each ...
- 6,454
0
votes
1
answer
75
views
Converting decompression stream to a regular stream
let decipher = crypto.createDecipheriv(type, file.metadata?.key, file.metadata?.iv)
let decompress = new fflate.Decompress()
let decipherStream = fs.createReadStream(location).pipe(decipher)
...
1
vote
0
answers
184
views
How to Convert a JSON Stream to NDJSON easily
How can I convert a fetch response stream where the document being downloaded is JSON to a NDJSON stream? For example this code:
const response = await fetch(url);
ndjsonStreamer = ndjsonStream(...
- 31
2
votes
1
answer
101
views
How to invoke actions on a continuous stream of json records using jq
So I have a process that writes a JSON record to stdout every second, how can I use jq to trigger an action after a certain amount (=x) of records are written and still have my output every second?
...
- 51
0
votes
0
answers
74
views
Streaming an object (as JSON) over the network in C#
I try to send an object of a specific class via the network in C# using the DataContractJsonSerializer class. Unfortunately the data seems not to be received by the recipient.
The following demo ...
- 13
0
votes
0
answers
59
views
Dynamically filter flowFiles based on data from table
I'm trying to using NIFI dynamically filter flowFiles in JSON format and keep only those values that are present is one SQL table.
I'm using QueryRecord processor, with query like:
SELECT *
FROM ...
- 57