amphp / byte-stream
A stream abstraction to make working with non-blocking I/O simple.
Fund package maintenance!
amphp
Installs: 71 209 765
Dependents: 91
Suggesters: 0
Security: 0
Stars: 366
Watchers: 7
Forks: 31
Open Issues: 2
Requires
- php: >=8.1
- amphp/amp: ^3
- amphp/parser: ^1.1
- amphp/pipeline: ^1
- amphp/serialization: ^1
- amphp/sync: ^2
- revolt/event-loop: ^1 || ^0.2.3
Requires (Dev)
- amphp/php-cs-fixer-config: ^2
- amphp/phpunit-util: ^3
- phpunit/phpunit: ^9
- psalm/phar: 5.22.1
- 2.x-dev
- v2.1.1
- v2.1.0
- v2.0.2
- v2.0.1
- v2.0.0
- v2.0.0-beta.14
- v2.0.0-beta.13
- v2.0.0-beta.12
- v2.0.0-beta.11
- v2.0.0-beta.10
- v2.0.0-beta.9
- v2.0.0-beta.8
- v2.0.0-beta.7
- v2.0.0-beta.6
- v2.0.0-beta.5
- v2.0.0-beta.4
- v2.0.0-beta.3
- v2.0.0-beta.2
- v2.0.0-beta.1
- 1.x-dev
- v1.8.2
- v1.8.1
- v1.8.0
- v1.7.3
- v1.7.2
- v1.7.1
- v1.7.0
- v1.6.1
- v1.6.0
- v1.5.1
- v1.5.0
- v1.4.0
- v1.3.1
- v1.3.0
- v1.2.5
- v1.2.4
- v1.2.3
- v1.2.2
- v1.2.1
- v1.2.0
- v1.1.6
- v1.1.5
- v1.1.4
- v1.1.3
- v1.1.2
- v1.1.1
- v1.1.0
- v1.0.3
- v1.0.2
- v1.0.1
- v1.0.0
- dev-ext-async
- dev-large-chunks
This package is auto-updated.
Last update: 2024-10-13 19:05:49 UTC
README
AMPHP is a collection of event-driven libraries for PHP designed with fibers and concurrency in mind.
amphp/byte-stream
specifically provides a stream abstraction to ease working with various byte streams.
Installation
This package can be installed as a Composer dependency.
composer require amphp/byte-stream
Requirements
This package requires PHP 8.1 or later.
Usage
Streams are an abstraction over ordered sequences of bytes. This package provides the fundamental interfaces ReadableStream
and WritableStream
.
Note Previous versions used the terms
InputStream
andOutputStream
, but these terms can be confusing depending on the use case.
ReadableStream
ReadableStream
offers a primary method: read()
. It returns a string
or null
. null
indicates that the stream has ended.
The following example shows a ReadableStream
consumption that buffers the complete stream contents.
$stream = ...; $buffer = ""; while (($chunk = $stream->read()) !== null) { $buffer .= $chunk; } // do something with $buffer
Note
Amp\ByteStream\buffer($stream)
can be used instead, but we'd like to demonstrate manual consumption here.
This package offers some basic implementations, other libraries might provide even more implementations, such as amphp/socket
.
Payload
ReadableBuffer
ReadableIterableStream
ReadableResourceStream
ReadableStreamChain
Base64DecodingReadableStream
Base64EncodingReadableStream
DecompressingReadableStream
Payload
Payload
implements ReadableStream
while also providing a buffer()
method for buffering the entire contents.
This allows consuming a message either in chunks (streaming) or consume everything at once (buffering).
When the object is destructed, any remaining data in the stream is automatically consumed and discarded.
This class is useful for small payloads or when the entire contents of a stream is needed before any processing can be done.
Buffering
Buffering a complete readable stream can be accomplished using the buffer()
method.
$payload = new Payload($inputStream); $content = $payload->buffer();
Streaming
Sometimes it's useful / possible to consume a payload in chunks rather than first buffering it completely, e.g. streaming a large HTTP response body directly to disk.
while (null !== $chunk = $payload->read()) { // Use $chunk here, works just like any other ReadableStream }
ReadableBuffer
An ReadableBuffer
allows creating a ReadableStream
from a single known string chunk.
This is helpful if the complete stream contents are already known.
$stream = new ReadableBuffer("foobar");
It also allows creating a stream without any chunks by passing null
as chunk / omitting the constructor argument:
$stream = new ReadableBuffer; // The stream ends immediately assert(null === $stream->read());
ReadableIterableStream
ReadableIterableStream
allows converting an iterable
that yields strings into a ReadableStream
:
$inputStream = new Amp\ByteStream\ReadableIterableStream((function () { for ($i = 0; $i < 10; $i++) { Amp\delay(1); yield $emit("."); } })());
ReadableResourceStream
This package abstracts PHP's stream resources with ReadableResourceStream
and WritableResourceStream
.
They automatically set the passed resource to non-blocking mode and allow reading and writing like any other ReadableStream
/ WritableStream
.
They also handle backpressure automatically by disabling the read watcher in case there's no read request and only activate a writability watcher if the underlying write buffer is already full, which makes them very efficient.
DecompressingReadableStream
This package implements compression based on Zlib. CompressingWritableStream
can be used for compression, while DecompressingReadableStream
can be used for decompression. Both can simply wrap an existing stream to apply them. Both accept an $encoding
and $options
parameter in their constructor.
$readableStream = new ReadableResourceStream(STDIN); $decompressingReadableStream = new DecompressingReadableStream($readableStream, \ZLIB_ENCODING_GZIP); while (null !== $chunk = $decompressingReadableStream) { print $chunk; }
See also: ./examples/gzip-decompress.php
WritableStream
WritableStream
offers two primary methods: write()
and end()
.
WritableStream::write
write()
writes the given string to the stream. Waiting for completion allows writing only as fast as the underlying stream can write and potentially send over a network. TCP streams will return immediately as long as the write buffer isn't full.
The writing order is always ensured, even if the writer doesn't wait for completion before issuing another write.
WritableStream::end
end()
marks the stream as ended. TCP streams might close the underlying stream for writing, but MUST NOT close it. Instead, all resources should be freed and actual resource handles be closed by PHP's garbage collection process.
The following example uses the previous example to read from a stream and writes all data to a WritableStream
:
$readableStream = ...; $writableStream = ...; $buffer = ""; while (($chunk = $readableStream->read()) !== null) { $writableStream->write($chunk); } $writableStream->end();
Note
Amp\ByteStream\pipe($readableStream, $writableStream)
can be used instead, but we'd like to demonstrate manual consumption / writing here.
This package offers some basic implementations, other libraries might provide even more implementations, such as amphp/socket
.
WritableBuffer
WritableIterableStream
WritableResourceStream
Base64DecodingWritableStream
Base64EncodingWritableStream
CompressingWritableStream
WritableResourceStream
This package abstracts PHP's stream resources with ReadableResourceStream
and WritableResourceStream
.
They automatically set the passed resource to non-blocking mode and allow reading and writing like any other ReadableStream
/ WritableStream
.
They also handle backpressure automatically by disabling the read watcher in case there's no read request and only activate a writability watcher if the underlying write buffer is already full, which makes them very efficient.
CompressingWritableStream
This package implements compression based on Zlib. CompressingWritableStream
can be used for compression, while DecompressingReadableStream
can be used for decompression. Both can simply wrap an existing stream to apply them. Both accept an $encoding
and $options
parameter in their constructor.
$writableStream = new WritableResourceStream(STDOUT); $compressedWritableStream = new CompressingWritableStream($writableStream, \ZLIB_ENCODING_GZIP); for ($i = 0; $i < 100; $i++) { $compressedWritableStream->write(bin2hex(random_bytes(32)); } $compressedWritableStream->end();
See also: ./examples/gzip-compress.php
Versioning
amphp/byte-stream
follows the semver semantic versioning specification like all other amphp
packages.
Security
If you discover any security related issues, please email me@kelunik.com
instead of using the issue tracker.
License
The MIT License (MIT). Please see LICENSE
for more information.