Commit Graph
100 Commits
Author SHA1 Message Date
b4tman ed37fee697 fix clippy warnings in tests 2023-08-13 12:33:19 +03:00
b4tman e0326e3b0a add questions ser/de tests
continuous-integration/drone/push Build is passing
2023-08-12 23:35:17 +03:00
b4tman c061fef267 questions: add skip_serializing_if attr's
continuous-integration/drone/push Build is passing
2023-08-12 22:53:36 +03:00
b4tman acf741e721 source tests: check write on write_sample_zip 2023-08-12 22:51:39 +03:00
b4tman e32316c6aa source: reformat struct's
continuous-integration/drone/push Build is passing
2023-08-12 22:34:01 +03:00
b4tman ef98b1fea4 add source::reader_async get/stream tests
continuous-integration/drone/push Build is passing
2023-08-12 22:11:36 +03:00
b4tman 08acb4e71b add source::reader_sync get/iter tests 2023-08-12 22:10:48 +03:00
b4tman 7e633577b1 add source batch ser/de tests 2023-08-12 22:08:25 +03:00
b4tman d4913a13f9 deps: add insta for tests 2023-08-12 21:42:14 +03:00
b4tman 21571787f2 source: add skip_serializing_if attr's 2023-08-12 21:40:33 +03:00
b4tman f874e59a11 fix convert feature without source
continuous-integration/drone/push Build is passing
2023-08-10 14:20:58 +03:00
b4tman 9c4882fbbb Merge branch 'master' into async
continuous-integration/drone/push Build is passing
2023-08-10 11:50:20 +03:00
b4tman b12048c38d PhantomData<Arc<T>> for Send to Reader/Writer
continuous-integration/drone/push Build is passing
2023-08-10 11:48:34 +03:00
b4tman 68b276ce5e PhantomData<Arc<T>>
continuous-integration/drone/push Build is passing
2023-08-10 11:20:38 +03:00
b4tman 48438c1aec Revert "ci: fix pipeline build"
continuous-integration/drone/push Build is passing
This reverts commit 851058245d.
2023-08-08 17:10:14 +03:00
b4tman f2fc72056b fmt
continuous-integration/drone/push Build is passing
2023-08-08 16:55:22 +03:00
b4tman 4c555df8ca fix async_db tests
using ZstdEncoder from ..:tokio::bufread instead of ..:tokio::write
2023-08-08 16:54:40 +03:00
b4tman daf41625ff remove debug prints 2023-08-08 16:52:30 +03:00
b4tman 2c3950ccfc fix write_db tokio join 2023-08-08 16:50:02 +03:00
b4tman 8306c76a0c fix app_async
continuous-integration/drone/push Build is failing
2023-08-08 14:31:08 +03:00
b4tman 965c021d83 fix async_db tests (to fail)
---
failures:
    async_db::test::test_write_read
    async_db::test::test_write_read_stream

thread 'async_db::test::test_write_read' panicked at 'get: "UnexpectedEnd { additional: 1 }
2023-08-08 14:29:18 +03:00
b4tman a1a1d41403 replace PhantomData in async_db::Writer
for Send for Writer
2023-08-08 14:25:01 +03:00
b4tman b768d27f83 combine convert sync/async features 2023-08-08 14:22:29 +03:00
b4tman 7cbf5439b7 rewrite SourceQuestionsZipReaderAsync
"impl Stream for SourceQuestionsZipReaderAsync" dropped
2023-08-08 14:20:40 +03:00
b4tman 8c4631e89f add app_async
-- write invalid:
"UnexpectedEnd { additional: 385 }"
2023-08-07 22:06:21 +03:00
b4tman 467ebfcc67 rewrite async converter
(poll_next removed // not work)
2023-08-07 22:04:29 +03:00
b4tman 80dda8d821 rewrite SourceQuestionsZipReaderAsync stream
(poll_next not work)
2023-08-07 22:02:41 +03:00
b4tman 851058245d ci: fix pipeline build
continuous-integration/drone/push Build is passing
2023-08-06 17:03:18 +03:00
b4tman ecfc34e821 + async source
(reader and converter)
2023-08-06 17:01:22 +03:00
b4tman f55b6f681c move str_err to util.rs 2023-08-06 16:58:43 +03:00
b4tman c0193e4f74 ci: add "publish" pipeline type
continuous-integration/drone/push Build is passing
2023-08-06 01:19:19 +03:00
b4tman a496f37ef2 ci: build/test with --all-features
continuous-integration/drone/push Build is passing
2023-08-06 01:09:57 +03:00
b4tman 5632c19866 ci: add pipeline type 2023-08-06 01:09:32 +03:00
b4tman cad8ff0404 add async test_share_reader 2023-08-06 01:05:36 +03:00
b4tman 39ce0d8ceb add async reader stream 2023-08-06 00:56:49 +03:00
b4tman 1ba645f337 add async reader 2023-08-06 00:12:15 +03:00
b4tman 150527efeb move macro to convert mod 2023-08-06 00:11:44 +03:00
b4tman 0c0a4e31ba optional feature for source
continuous-integration/drone/push Build is passing
2023-08-05 23:26:45 +03:00
b4tman abcb7d6dc2 add async writer
continuous-integration/drone/push Build is passing
2023-08-05 23:10:30 +03:00
b4tman 307790ce49 fix set_pledged_src_size 2023-08-05 23:07:16 +03:00
b4tman a6e5931f35 add sync/async features 2023-08-05 23:06:55 +03:00
b4tman 1e8cd4b461 cargo update
continuous-integration/drone/push Build is passing
2023-07-19 14:43:22 +03:00
b4tman 9246d06783 cargo fix 2023-07-19 14:40:56 +03:00
b4tman cc5ab52f32 ref bench 2023-07-19 14:40:25 +03:00
b4tman e7491f6d3a upd clap to v4 2023-05-07 18:15:45 +03:00
b4tman 39d4d6b610 add locks + file alloc in Writer::finish
continuous-integration/drone/push Build is passing
2023-04-05 16:53:40 +03:00
b4tman 27260695f7 upd lock
continuous-integration/drone/push Build is passing
2023-04-03 15:35:58 +03:00
b4tman f5bd72b298 fix publish 2
continuous-integration/drone/push Build is passing
2023-03-29 13:46:21 +03:00
b4tman dda50e7d2b fix build on publish
continuous-integration/drone/push Build is passing
2023-03-29 13:31:23 +03:00
b4tman 693f349ae3 fix license 2023-03-29 13:30:57 +03:00
b4tman 7a2e58b1b9 remove branch filter for publish
continuous-integration/drone/push Build is passing
2023-03-29 13:23:03 +03:00
b4tman 9570b1d6e2 add manifest info 2023-03-29 13:22:37 +03:00
b4tman 5355d0398d remove ledb
continuous-integration/drone Build is passing
2023-03-29 13:00:17 +03:00
b4tman b63e9aa45c add publish pipeline 2023-03-29 12:59:35 +03:00
b4tman 8120a996a3 add test_share_reader
continuous-integration/drone/push Build is passing
2023-03-28 15:43:08 +03:00
b4tman 3a26a4aa7f upd bench 2023-03-28 15:37:21 +03:00
b4tman 103b677d21 into_iter() for reader 2023-03-28 15:01:14 +03:00
b4tman e18539a982 reader without mut 2023-03-28 14:59:44 +03:00
b4tman 249ac3a4ef ci: use sparse protocol for crates.io
continuous-integration/drone/push Build is passing
2023-03-13 17:10:09 +03:00
b4tman e940f1c37c cargo update
continuous-integration/drone/push Build is passing
2023-03-02 14:50:06 +03:00
b4tman f3dabe7a06 new db file rename 2023-01-03 23:52:50 +03:00
b4tman e521e39f5e add ledb read/write benches
continuous-integration/drone/push Build is passing
2022-11-10 22:21:55 +03:00
b4tman cf591198a0 separate lib
continuous-integration/drone/push Build is passing
2022-11-10 21:43:15 +03:00
b4tman be6b17a8e2 db::read -- io::Cursor instead of take
continuous-integration/drone/push Build is passing
2022-11-09 21:31:38 +03:00
b4tman 6a3b3647b3 db read with mmap
continuous-integration/drone/push Build is passing
2022-11-09 21:03:35 +03:00
b4tman 7efd03d624 add db_bench
continuous-integration/drone/push Build is passing
2022-10-16 01:29:37 +03:00
b4tman a05edad5f7 db::WriterOpts reduce current_buf_size
continuous-integration/drone/push Build is passing
2022-10-13 21:27:41 +03:00
b4tman 5f4fc35b71 db::test::TestData variable length 2022-10-13 21:24:50 +03:00
b4tman 78b319e41a db::Writer::load use size_hint for table.reserve 2022-10-13 21:23:55 +03:00
b4tman 38cee92d5f db::Writer share cur_buf_raw 2022-10-13 20:57:20 +03:00
b4tman 3f4a144431 drone ci: apk add musl-dev
continuous-integration/drone/push Build is passing
2022-10-12 18:07:50 +03:00
b4tman bef08e6166 add .drone.yml
continuous-integration/drone/push Build is failing
2022-10-12 18:01:38 +03:00
b4tman 5ed8c12f91 use collection.load(rx) for writer task 2022-10-10 16:15:16 +03:00
b4tman 2acb324da9 use forked ledb
with fixed collection.load()
2022-10-10 16:14:47 +03:00
b4tman dbf9e8cdac rename reader_task 2022-10-10 16:13:59 +03:00
b4tman f275069f23 move enumerate to reader_task 2022-10-10 16:12:51 +03:00
b4tman 17446a6318 fmt 2022-10-10 15:42:43 +03:00
b4tman 7c27a20ebd fix Writer / remove [where Debug] 2022-10-10 01:19:44 +03:00
b4tman f361a35b65 use tempfile::tempdir for tests 2022-10-10 01:05:54 +03:00
b4tman efec662700 upd bench 2022-10-10 00:09:17 +03:00
b4tman a5ca0c65a7 add iter for reader 2022-10-10 00:08:57 +03:00
b4tman c28508b147 add test write/read + fix write 2022-10-09 23:54:58 +03:00
b4tman f51f2be18f add db::Writer::load 2022-10-09 18:26:00 +03:00
b4tman 3b24a1be2f separate new db reader+writer from main 2022-10-09 16:43:17 +03:00
b4tman 35b8aaadc7 remove debug prints 2022-10-09 13:38:25 +03:00
b4tman 76f794f167 data format in README 2022-10-08 15:39:54 +03:00
b4tman 8ad88490e7 optimize zstd writer 2022-10-08 02:02:27 +03:00
b4tman 73e8b34af4 skip tab len 2022-10-07 23:00:09 +03:00
b4tman 9316bbbf5c common len type and size 2022-10-07 16:26:08 +03:00
b4tman 7ee0b62ed7 reader buf 100M => 4K 2022-10-07 16:09:44 +03:00
b4tman 16784a3319 min tab 2 2022-10-07 15:43:22 +03:00
b4tman 42fc486872 min tab 1 2022-10-07 11:53:17 +03:00
b4tman 5a4086cfdf test fmt 1 2022-10-06 21:22:19 +03:00
b4tman 2996aefa7b write_db with threads 2022-10-05 16:21:52 +03:00
b4tman f7f713ade8 split source/converter 2022-10-05 15:19:32 +03:00
b4tman 7389290d80 SourceQuestionsZipReader: Iterator 2022-10-04 23:01:54 +03:00
b4tman 0b20188fce add README 2022-10-02 17:52:22 +03:00
b4tman cc3ac2d788 add LICENSE 2022-10-02 17:40:27 +03:00
b4tman cd8298577e ignore .vscode folder 2022-09-18 14:22:33 +03:00
b4tman 3e4b4325f3 profile.release 2022-09-18 14:05:07 +03:00