arrow-cookbook.git
2 days ago[Python] Add Python build against Arrow Nightlies version (#264) main
Raúl Cumplido [Tue, 4 Oct 2022 13:29:43 +0000 (15:29 +0200)] 
[Python] Add Python build against Arrow Nightlies version (#264)

2 days ago[Java] Add Java build against Arrow Nightlies version (#253)
Raúl Cumplido [Tue, 4 Oct 2022 13:27:36 +0000 (15:27 +0200)] 
[Java] Add Java build against Arrow Nightlies version (#253)

* [Java] Add initial Java build against Arrow Nightlies version

* Update Java version to use 10.0.0-SNAPSHOT if ARROW_NIGHTLY is defined and not empty

* Fix typo on GitHub Worflow

* Test define env var to 0

* Add excludes to not run all combinations

* Add documentation and try numeric values instead of string for the environment variable

* Specifically check whether ARROW_NIGHTLY is 0 or not

* Add OSX combination

2 weeks ago[Java] Update create.rst to address typos: "slice" was written as "splice" #259 ...
Larry White [Wed, 21 Sep 2022 20:33:06 +0000 (16:33 -0400)] 
[Java] Update create.rst to address typos: "slice" was written as "splice" #259 (#260)

* Update create.rst to address typos: "slice" was written as "splice"

* Apply suggestions from code review

Co-authored-by: David Li <li.davidm96@gmail.com>
4 weeks ago[C++] Add C++ build against Arrow Nightlies version (#252)
Raúl Cumplido [Tue, 6 Sep 2022 14:36:43 +0000 (16:36 +0200)] 
[C++] Add C++ build against Arrow Nightlies version (#252)

6 weeks ago[Java] Add Arrow Java JDBC adapter examples (#229)
david dali susanibar arce [Tue, 23 Aug 2022 15:39:39 +0000 (10:39 -0500)] 
[Java] Add Arrow Java JDBC adapter examples (#229)

* Adding Arrow Java JDBC adapter examples

* Apply suggestions from code review

Co-authored-by: David Li <li.davidm96@gmail.com>
* Adding precision/scale cookbook

* Adding Java version and Java compiler defined by CI configuration

* Configure only arrow stable/dev version and only 11 compiler

* Delete testing environmet variables validation

* Setup JRE/Compiler/Arrow version and Memory database

* Apply suggestions from code review

Co-authored-by: David Li <li.davidm96@gmail.com>
* Jdbc recipes + Solve code indentation style

* Apply suggestions from code review

Co-authored-by: David Li <li.davidm96@gmail.com>
* Adding default values to maven that should be updated by CI with parameters needed

* Remove all the changes to the build/CI config

Co-authored-by: David Li <li.davidm96@gmail.com>
6 weeks ago[R] Add license headers (#249)
Ash [Mon, 22 Aug 2022 16:45:59 +0000 (09:45 -0700)] 
[R] Add license headers (#249)

7 weeks agoRemove now-incorrect content (#248)
Nic Crane [Thu, 18 Aug 2022 21:38:00 +0000 (22:38 +0100)] 
Remove now-incorrect content (#248)

8 weeks agoMINOR: Add license header to files (#245)
Ash [Thu, 11 Aug 2022 11:16:41 +0000 (04:16 -0700)] 
MINOR: Add license header to files (#245)

* added license text

* added missing license header

* rolledbacl r package changes

8 weeks agoMINOR: Add missing license headers (#243)
Ash [Tue, 9 Aug 2022 11:37:03 +0000 (04:37 -0700)] 
MINOR: Add missing license headers (#243)

8 weeks ago[Java] Add splicing non-zero index example (#242)
Ash [Mon, 8 Aug 2022 11:48:50 +0000 (04:48 -0700)] 
[Java] Add splicing non-zero index example (#242)

* added non-zero index splicing example

* fixed build failure

* merged examples into one

2 months ago[C++] Bump Arrow to 9.0.0 (#241)
David Li [Fri, 5 Aug 2022 16:48:25 +0000 (12:48 -0400)] 
[C++] Bump Arrow to 9.0.0 (#241)

2 months ago[C++] Updated the hyperlink formatting for Code of Conduct (#239)
Ash [Fri, 5 Aug 2022 11:41:27 +0000 (04:41 -0700)] 
[C++] Updated the hyperlink formatting for Code of Conduct (#239)

* fixed hyperlink formatting issue

* Revert "fixed hyperlink formatting issue"

This reverts commit b52ecc1f036a3ae1599dcaef2b1caaab426590ae.

* fixed hyperlink formatting issue

* updated fomratting as markdown syntax

2 months ago[Java] Added splicing example for IntVector (#237)
Ash [Thu, 4 Aug 2022 15:01:33 +0000 (08:01 -0700)] 
[Java] Added splicing example for IntVector (#237)

* added splicing example

* updated content

* Update java/source/create.rst

updated per review comment

Co-authored-by: david dali susanibar arce <davi.sarces@gmail.com>
* Update java/source/create.rst

updated per review comment

Co-authored-by: David Li <li.davidm96@gmail.com>
* Update java/source/create.rst

update per review comment

Co-authored-by: David Li <li.davidm96@gmail.com>
* updated per review comment

* fixed formatting

Co-authored-by: david dali susanibar arce <davi.sarces@gmail.com>
Co-authored-by: David Li <li.davidm96@gmail.com>
2 months ago[Java][Python] Bump to Arrow 9.0.0 (#238)
David Li [Thu, 4 Aug 2022 12:58:47 +0000 (08:58 -0400)] 
[Java][Python] Bump to Arrow 9.0.0 (#238)

2 months ago[Java] Added section for converting Avro to Arrow (#235)
Ash [Thu, 4 Aug 2022 12:58:14 +0000 (05:58 -0700)] 
[Java] Added section for converting Avro to Arrow (#235)

* added avro receipe

* updated receipe

* Update java/source/avro.rst

Co-authored-by: david dali susanibar arce <davi.sarces@gmail.com>
* Update java/source/avro.rst

Co-authored-by: David Li <li.davidm96@gmail.com>
* updated per review comments in PR

* fixed extra space issue

Co-authored-by: david dali susanibar arce <davi.sarces@gmail.com>
Co-authored-by: David Li <li.davidm96@gmail.com>
2 months ago[Java] Add missing license headers (#234)
Ashish [Fri, 29 Jul 2022 17:38:25 +0000 (10:38 -0700)] 
[Java] Add missing license headers (#234)

Related to #126.

2 months ago[Java] Added missing semicolon in Working with Schema page (#232)
Ashish [Thu, 28 Jul 2022 12:40:21 +0000 (05:40 -0700)] 
[Java] Added missing semicolon in Working with Schema page (#232)

* added missing semicolon

* added semicolon in one more receipe

2 months agoMINOR: update copyright year to 2022 (#230)
Neal Richardson [Mon, 18 Jul 2022 14:00:04 +0000 (10:00 -0400)] 
MINOR: update copyright year to 2022 (#230)

3 months agoAdd link to Rust examples (#185)
Andrew Lamb [Wed, 6 Jul 2022 19:22:56 +0000 (15:22 -0400)] 
Add link to Rust examples (#185)

3 months ago[Python] Add example for pa.Table.from_pylist (#226)
Edward Visel [Wed, 6 Jul 2022 19:20:48 +0000 (14:20 -0500)] 
[Python] Add example for pa.Table.from_pylist (#226)

3 months agoUpdate Arrow/PyArrow versions, fix build errors (#225)
David Li [Wed, 6 Jul 2022 18:53:36 +0000 (14:53 -0400)] 
Update Arrow/PyArrow versions, fix build errors (#225)

Fixes #224.

4 months ago[Java] Fix memory management issues in Flight example (#219)
David Li [Thu, 2 Jun 2022 17:31:43 +0000 (13:31 -0400)] 
[Java] Fix memory management issues in Flight example (#219)

Fixes #218.

4 months ago[Java] Adding examples about Dictionary-encoded Layout (#215)
david dali susanibar arce [Wed, 25 May 2022 12:19:24 +0000 (07:19 -0500)] 
[Java] Adding examples about Dictionary-encoded Layout (#215)

* Addind examples about Dictionary-encoded Layout

* Apply suggestions from code review

Co-authored-by: David Li <li.davidm96@gmail.com>
* Solving issues: variable name, null indexType

* Solving issues: variable name

* Adding dictionary id base on DictionaryEncoding and FieldType

Co-authored-by: David Li <li.davidm96@gmail.com>
4 months ago[Java] Clarifying dependencies to build Java cookbook (#193)
Todd Farmer [Tue, 24 May 2022 18:57:16 +0000 (12:57 -0600)] 
[Java] Clarifying dependencies to build Java cookbook (#193)

4 months ago[R] Remove unnecessary extra test which is causing build failure (#209)
Nicola Crane [Mon, 16 May 2022 11:54:47 +0000 (12:54 +0100)] 
[R] Remove unnecessary extra test which is causing build failure (#209)

4 months ago[R] Swap code solutions for read / write CSV (#192)
John MacKintosh [Mon, 16 May 2022 10:14:34 +0000 (11:14 +0100)] 
[R] Swap code solutions for read / write CSV  (#192)

* Update reading_and_writing_data.Rmd

Swap code solutions for read_csv_arrow and write_csv_arrow as the solutions are provided in the wrong order at present

4 months ago[Java] Parquet reading example fails with Arrow v8.0 (#207)
david dali susanibar arce [Fri, 13 May 2022 21:27:57 +0000 (16:27 -0500)] 
[Java] Parquet reading example fails with Arrow v8.0 (#207)

* Parquet reading example fails with Arrow v8.0

* Solve incorrect indentation

* Delete code not used

4 months ago[Java] Link to install instructions (#200)
David Li [Thu, 12 May 2022 14:47:38 +0000 (10:47 -0400)] 
[Java] Link to install instructions (#200)

4 months ago[Python] Fix test output examples that changed in 8.0.0 (#195)
David Li [Wed, 11 May 2022 15:56:52 +0000 (11:56 -0400)] 
[Python] Fix test output examples that changed in 8.0.0 (#195)

4 months ago[Java] Fixing broken link in CONTRIBUTING.md for Java (#189)
Todd Farmer [Mon, 9 May 2022 17:16:28 +0000 (11:16 -0600)] 
[Java] Fixing broken link in CONTRIBUTING.md for Java (#189)

5 months agoadd pandoc path hint; list dependencies (#167)
Stephanie Hazlitt [Fri, 29 Apr 2022 07:36:09 +0000 (00:36 -0700)] 
add pandoc path hint; list dependencies (#167)

5 months agoARROW-16291: [Java] Support JSE17 for Java Cookbooks (#184)
david dali susanibar arce [Mon, 25 Apr 2022 17:19:20 +0000 (12:19 -0500)] 
ARROW-16291: [Java] Support JSE17 for Java Cookbooks (#184)

* Initial commit to test Arrow Java with JSE17/18

* Solving problems with SemVer

* Empty-Commit

* Adding actions/setup-python@v3

5 months agoARROW-16170: [Java][Docs] Synch java code tutorial with java cookbook (#183)
david dali susanibar arce [Tue, 12 Apr 2022 18:58:34 +0000 (13:58 -0500)] 
ARROW-16170: [Java][Docs] Synch java code tutorial with java cookbook (#183)

* Synch java code tutorial with java cookbook

* Apply suggestions from code review

Co-authored-by: David Li <li.davidm96@gmail.com>
* Solving PR comments

* Apply suggestions from code review

Co-authored-by: David Li <li.davidm96@gmail.com>
* Solving PR comments

Co-authored-by: David Li <li.davidm96@gmail.com>
5 months ago[Flight] Add Python Server Client Example with Certificates (#177)
Christopher Dunderdale [Mon, 11 Apr 2022 19:23:41 +0000 (21:23 +0200)] 
[Flight] Add Python Server Client Example with Certificates (#177)

* Include Python Server Client Example with Certificates

* Update code output to not be hit by unit tests

* Pull request comments

* Fix build issues

* fix more build issues

* More fixes

* Fix more issues (part 3)

* Another attempt to fix build issues

* spacing after testcode

* Address comments

* Address comments

* address final comments

6 months ago[Python] Fix links to pyarrow docs (#178)
Albert Villanova del Moral [Thu, 7 Apr 2022 14:15:19 +0000 (16:15 +0200)] 
[Python] Fix links to pyarrow docs (#178)

6 months agoMinor spelling corrections to Python and Java contribution files (#175)
Christopher Dunderdale [Tue, 5 Apr 2022 08:55:17 +0000 (10:55 +0200)] 
Minor spelling corrections to Python and Java contribution files (#175)

* Fix python heading spelling

* Fix java contribution file heading

6 months ago[C++] Add TypeVisitor example (#166)
Will Jones [Mon, 28 Mar 2022 17:14:24 +0000 (10:14 -0700)] 
[C++] Add TypeVisitor example (#166)

* Start visitor example

* Get a working visitor pattern

* Add random data generator example

* Revert makefile change

* Apply suggestions from code review

Co-authored-by: Antoine Pitrou <pitrou@free.fr>
* Merge

* Reorganize examples and add prose

* PR feedback

* Update cpp/code/creating_arrow_objects.cc

Co-authored-by: Antoine Pitrou <pitrou@free.fr>
* Adjust types to be more specific

* Update cpp/code/basic_arrow.cc

Co-authored-by: Antoine Pitrou <pitrou@free.fr>
Co-authored-by: Antoine Pitrou <pitrou@free.fr>
6 months agoAdd highlighting to testcode nodes (#164)
Alessandro Molina [Fri, 18 Mar 2022 14:15:26 +0000 (15:15 +0100)] 
Add highlighting to testcode nodes (#164)

6 months agoUse ARROW_RETURN_NOT_OK (and friends) instead of ASSERT_OK (and friends) in recipes...
Weston Pace [Thu, 17 Mar 2022 02:04:58 +0000 (16:04 -1000)] 
Use ARROW_RETURN_NOT_OK (and friends) instead of ASSERT_OK (and friends) in recipes (#52)

* Modified existing recipes to use a status returning method to contain the recipe so that we can use ARROW_RETURN_NOT_OK instead of ASSERT_OK in our examples.

6 months ago[CI] Run apt update before apt install (#163)
David Li [Tue, 15 Mar 2022 17:12:39 +0000 (13:12 -0400)] 
[CI] Run apt update before apt install (#163)

6 months ago[Java] Add Java recipes for Arrow Flight (#137)
david dali susanibar arce [Mon, 14 Mar 2022 19:48:17 +0000 (14:48 -0500)] 
[Java] Add Java recipes for Arrow Flight (#137)

* Adding java cookbook for creating arrow flight

* Adding java cookbook for creating arrow flight

* Solving pr comments

* Change text to flightscope

* Solving PR comments

* Solving PR comments

* Solving PR comments

* Solving PR comments

* Solving PR comments

* Solving PR comments

* Solving PR comments

* Solving PR comments

6 months ago[Python] Add a Python Cookbook recipe on group_by + sort (#155)
Vibhatha Lakmal Abeykoon [Thu, 10 Mar 2022 18:43:06 +0000 (00:13 +0530)] 
[Python] Add a Python Cookbook recipe on group_by + sort (#155)

7 months ago[C++] gRPC settings and custom endpoint examples (#153)
Will Jones [Fri, 25 Feb 2022 00:03:36 +0000 (16:03 -0800)] 
[C++] gRPC settings and custom endpoint examples (#153)

* Draft options example

* Get flight examples to compile

* Start creating client for gRPC custom service

* Fix test

* Cleanup

* PR feedback

* Further cleanup

* Remove references to other ports

7 months agoMake the sphinx docs wide enough for code examples (#151)
Will Jones [Thu, 24 Feb 2022 14:01:59 +0000 (06:01 -0800)] 
Make the sphinx docs wide enough for code examples (#151)

7 months ago[Python] Add a recipe on how to replace an existing column in Table (#154)
Vibhatha Lakmal Abeykoon [Thu, 24 Feb 2022 10:04:05 +0000 (15:34 +0530)] 
[Python] Add a recipe on how to replace an existing column in Table (#154)

7 months ago[C++] Small fixes for c++ (#150)
Will Jones [Wed, 23 Feb 2022 03:24:23 +0000 (19:24 -0800)] 
[C++] Small fixes for c++ (#150)

* Small fixes for c++

* Edits to contributing

* Upgrade to conda-lock

* Specify python in environment

* Fix instructions

7 months ago[Java] Java cookbook for create arrow jni dataset (#138)
david dali susanibar arce [Tue, 22 Feb 2022 13:01:56 +0000 (08:01 -0500)] 
[Java] Java cookbook for create arrow jni dataset (#138)

* Adding java cookbook for creating arrow jni

* JNI library dependencies

* Adding java cookbook for creating arrow jni

* Adding java cookbook for creating arrow jni

* Adding java cookbook for creating arrow jni

* Testing problem with download dependencies

* Debug jni errors

* Debug jni errors

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Solving jni errors for jni *.dylib and *.so library dependencies

* Custom protobuf.rb formula

* Adding parquet files

* Configure ci worflow for jni and not jni

* Configure ci worflow for jni and not jni

* Configure ci worflow for jni and not jni

* Configure ci worflow for jni and not jni

* Configure ci worflow for jni and not jni

* Configure ci worflow for jni and not jni

* Configure ci worflow for jni and not jni

* Configure ci worflow for jni and not jni

* Configure ci worflow for jni and not jni

* Configure ci worflow for jni and not jni

* Configure ci worflow for jni and not jni

* Adding github cache for protobuf lib

* Adding github cache for protobuf lib

* Adding github cache for protobuf lib

* Adding github cache for protobuf lib

* Adding github cache for protobuf lib

* Adding github cache for protobuf lib

* Adding github cache for protobuf lib

* Adding github cache for protobuf lib

* Adding github cache for protobuf lib

* Adding github cache for protobuf lib

* Adding JNI testing cookbooks

* Arrow jni dataset for version 7.0.0

* Arrow jni dataset for version 7.0.0

* Solving error: Failed to collect dependencies

* Solving error: Failed to collect dependencies

* Update java/source/dataset.rst

Co-authored-by: David Li <li.davidm96@gmail.com>
* Solving pr comments

* Update java/source/dataset.rst

Co-authored-by: David Li <li.davidm96@gmail.com>
* Update java/source/dataset.rst

Co-authored-by: David Li <li.davidm96@gmail.com>
* Update java/source/dataset.rst

Co-authored-by: David Li <li.davidm96@gmail.com>
* Update java/source/dataset.rst

Co-authored-by: David Li <li.davidm96@gmail.com>
* Solving pr comments

* Solving pr comments

* Solving pr comments

* Solving pr comments

Co-authored-by: David Li <li.davidm96@gmail.com>
7 months ago[Java] Java cookbook for create arrow read/write IPC format (#136)
david dali susanibar arce [Mon, 21 Feb 2022 14:50:20 +0000 (09:50 -0500)] 
[Java] Java cookbook for create arrow read/write IPC format (#136)

* Adding java cookbook for creating arrow read/write IPC format

* Adding java cookbook for creating arrow read/write IPC format

* Update java/source/io.rst

Co-authored-by: David Li <li.davidm96@gmail.com>
* Update java/source/io.rst

Co-authored-by: David Li <li.davidm96@gmail.com>
* Solving pr comments

* Solving pr comments

* Solving pr comments

* Arrow java io cookbook

* Solving pr comments

* Solving pr comments

* Solving pr comments

* Solving pr comments

* Solving pr comments

Co-authored-by: David Li <li.davidm96@gmail.com>
7 months ago[Python][Flight] Add an 'HTTP basic auth' example (#123)
David Li [Wed, 9 Feb 2022 16:58:27 +0000 (11:58 -0500)] 
[Python][Flight] Add an 'HTTP basic auth' example (#123)

7 months ago[Python] Make Flight tests idempotent (#145)
David Li [Wed, 9 Feb 2022 16:39:45 +0000 (11:39 -0500)] 
[Python] Make Flight tests idempotent (#145)

Use a temporary directory instead of the current working directory.
Also, remove calls to FlightServerBase.serve() (they're unnecessary
since the server is active as soon as it's created).

7 months ago[C++][Flight] Add basic Flight service (#124)
David Li [Wed, 9 Feb 2022 16:36:44 +0000 (11:36 -0500)] 
[C++][Flight] Add basic Flight service (#124)

7 months ago[Java]: Java cookbook for create arrow data manipulation (#135)
david dali susanibar arce [Tue, 8 Feb 2022 14:28:14 +0000 (09:28 -0500)] 
[Java]: Java cookbook for create arrow data manipulation (#135)

* Adding java cookbook for arrow data manipulation

* Adding java cookbook for creating arrow data manipulation

* Solving pr comments

Co-authored-by: David Li <li.davidm96@gmail.com>
7 months agoDropped the googletest dependency down to 1.10. This lets us get it from conda....
Weston Pace [Tue, 8 Feb 2022 10:45:58 +0000 (00:45 -1000)] 
Dropped the googletest dependency down to 1.10.  This lets us get it from conda.  Upped the arrow version to 6.0.0.  Added UseAsync back in, as its removal was based on 7.0.0, which is a touch premature as 7.0.0 is not in conda yet. (#144)

8 months agoRemoved call to UseAsync (#143)
Weston Pace [Fri, 4 Feb 2022 22:14:52 +0000 (12:14 -1000)] 
Removed call to UseAsync (#143)

In Arrow 7.0.0 the `arrow::dataset::ScannerBuilder::UseAsync` call was removed.

8 months ago[Java]: Java cookbook for create arrow object (#131)
david dali susanibar arce [Fri, 4 Feb 2022 16:52:59 +0000 (11:52 -0500)] 
[Java]: Java cookbook for create arrow object (#131)

* Adding java cookbook for creating arrow object

* Solving pr comments

* Solving pr comments

Co-authored-by: David Li <li.davidm96@gmail.com>
Co-authored-by: Alessandro Molina <amol@turbogears.org>
8 months ago[Java]: Java cookbook for create arrow schema (#134)
david dali susanibar arce [Thu, 27 Jan 2022 10:19:04 +0000 (05:19 -0500)] 
[Java]: Java cookbook for create arrow schema (#134)

* Adding java cookbook for creating arrow schema

* minor change to trigger ci

Co-authored-by: Alessandro Molina <amol@turbogears.org>
8 months ago[Java] Cookbook CI (#133)
Alessandro Molina [Tue, 25 Jan 2022 16:45:30 +0000 (17:45 +0100)] 
[Java] Cookbook CI (#133)

* Add Java cookbook testing

* Add Java cookbook deploy

8 months ago[Java]: Setup java arrow cookbook doc and testing baseline (#125)
david dali susanibar arce [Tue, 25 Jan 2022 14:25:27 +0000 (09:25 -0500)] 
[Java]: Setup java arrow cookbook doc and testing baseline (#125)

* Setup java arrow cookbook doc and testing baseline

* Update java/ext/javadoctest.py

Co-authored-by: David Li <li.davidm96@gmail.com>
* Adding support for jdk9+ that does not support dash in bash/pipe

Co-authored-by: David Li <li.davidm96@gmail.com>
8 months agoUpdate reading_and_writing_data.Rmd (#117)
Benjamin Wolfe [Fri, 21 Jan 2022 10:29:02 +0000 (04:29 -0600)] 
Update reading_and_writing_data.Rmd (#117)

Add blank line to format bulleted list correctly

8 months agoFix Markdown/Jira-style links in README (#128)
David Li [Wed, 19 Jan 2022 19:42:22 +0000 (14:42 -0500)] 
Fix Markdown/Jira-style links in README (#128)

8 months agoAdd missing C++ Cookbook link in CONTRIBUTING.md (#127)
David Li [Wed, 19 Jan 2022 17:27:05 +0000 (12:27 -0500)] 
Add missing C++ Cookbook link in CONTRIBUTING.md (#127)

8 months ago[Python] Add Flight streaming example (#109)
David Li [Wed, 19 Jan 2022 10:23:25 +0000 (05:23 -0500)] 
[Python] Add Flight streaming example (#109)

* [Python] Add Flight streaming example

Fixes #86

* [Python] Remove special dataset example

* [Python] Add back missing server shutdown

8 months agoMerge pull request #119 from apache/contributing-typos
Alessandro Molina [Wed, 19 Jan 2022 10:19:51 +0000 (11:19 +0100)] 
Merge pull request #119 from apache/contributing-typos

Add note in CONTRIBUTING.MD about typos

8 months ago[R] Fix hyperlink (#114)
Tony Fujs [Tue, 18 Jan 2022 14:24:06 +0000 (11:24 -0300)] 
[R] Fix hyperlink (#114)

* Fix hyperlink

* Update r/content/arrays.Rmd

* Update r/content/arrays.Rmd

Co-authored-by: David Li <li.davidm96@gmail.com>
Co-authored-by: Nic Crane <thisisnic@gmail.com>
Co-authored-by: David Li <li.davidm96@gmail.com>
8 months agoSwap all instances of Table$create for arrow_table (#112)
Nic Crane [Sun, 16 Jan 2022 18:00:13 +0000 (18:00 +0000)] 
Swap all instances of Table$create for arrow_table (#112)

8 months agoAdd note in CONTRIBUTING.MD about typos contributing-typos 119/head
Nic Crane [Sun, 16 Jan 2022 17:57:48 +0000 (17:57 +0000)] 
Add note in CONTRIBUTING.MD about typos

8 months agoDescribe recipes and differentiate from user guides (#118)
Will Jones [Sun, 16 Jan 2022 17:53:37 +0000 (09:53 -0800)] 
Describe recipes and differentiate from user guides (#118)

* Describe recipes and differentiate from user guides

* Update CONTRIBUTING.md

Co-authored-by: Nic Crane <thisisnic@gmail.com>
10 months agoAdd link to the README (#102)
Nic Crane [Tue, 16 Nov 2021 15:09:12 +0000 (15:09 +0000)] 
Add link to the README (#102)

11 months agoFix broken build and aesthetic improvements (#103)
Nic Crane [Wed, 3 Nov 2021 21:03:25 +0000 (21:03 +0000)] 
Fix broken build and aesthetic improvements (#103)

* Add arrow logo

* Add missing solution headings

* Shorten section titles

* Delete redundant content

* Add link to R docs

* Rename intro sections

11 months agoAesthetic improvements to intro page (#101)
Nic Crane [Wed, 3 Nov 2021 12:49:32 +0000 (12:49 +0000)] 
Aesthetic improvements to intro page (#101)

* Add arrow logo

* Use includegraphics and add link to dplyr

11 months agoUpdate preface (#100)
Nic Crane [Wed, 3 Nov 2021 10:25:22 +0000 (10:25 +0000)] 
Update preface (#100)

11 months agoARROW-13749: [Doc][Cookbook] Work with functions from other packages via dplyr bindin...
Nic Crane [Wed, 3 Nov 2021 10:06:05 +0000 (10:06 +0000)] 
ARROW-13749: [Doc][Cookbook] Work with functions from other packages via dplyr bindings - R (#95)

* Add content on using functions from other packages

* Add links to packages

11 months agoARROW-13714: [Doc][Cookbook] Sharing data between R and Python - R (#99)
Nic Crane [Wed, 3 Nov 2021 09:55:47 +0000 (09:55 +0000)] 
ARROW-13714: [Doc][Cookbook] Sharing data between R and Python - R (#99)

* Initial file

* Add to bookdown file

* Add examples

* Add example of PyArrow functions

* Initial file

* Add to bookdown

* Add examples

* Add example of PyArrow functions

* Capitalisation

* Update dependencies

* Add pyarrow installation

* Consistent capitalisation

11 months agoARROW-13752 [Doc][Cookbook] Searching for values matching a predicate in Arrays...
Nic Crane [Wed, 3 Nov 2021 09:54:45 +0000 (09:54 +0000)] 
ARROW-13752  [Doc][Cookbook] Searching for values matching a predicate in Arrays - R (#96)

* Add in extra recipes

* Rephrase to make more idiomatic

11 months agoARROW-13713: [Doc][Cookbook] Reading and Writing Compressed Data - R (#91)
Nic Crane [Mon, 1 Nov 2021 05:43:49 +0000 (05:43 +0000)] 
ARROW-13713: [Doc][Cookbook] Reading and Writing Compressed Data - R (#91)

* Add initial recipes

* Add to bookdown

* Move "compressed data" content to the "read and write data" chapter

* Add "Solution" headings

* Write parquet not feather!

* Add .gz ending note

* Add note about defaults

* Add note in see also section

* Add comment about default compression

* Add to comment

11 months agoUpdate python tests for version 6.0.0 (#98)
Alessandro Molina [Thu, 28 Oct 2021 12:18:59 +0000 (14:18 +0200)] 
Update python tests for version 6.0.0 (#98)

* Update python tests for version 6.0.0

* Adapt to new partitioning convention

11 months ago[R] - Flight recipes (#90)
Nic Crane [Thu, 28 Oct 2021 09:23:46 +0000 (12:23 +0300)] 
[R] - Flight recipes (#90)

* Flight recipes

* Add code to make examples self-contained

* "discussion" -> "see also"

* In in solution headings

* Use sentence case and remove "ing" from first verb in title

* Mention it's a pyarrow thing

* Update r/content/flight.Rmd

Co-authored-by: Weston Pace <weston.pace@gmail.com>
Co-authored-by: Weston Pace <weston.pace@gmail.com>
11 months agoARROW-13712: Reading and Writing Compressed Data (#87)
Alessandro Molina [Thu, 28 Oct 2021 09:22:05 +0000 (11:22 +0200)] 
ARROW-13712: Reading and Writing Compressed Data (#87)

* ARROW-13712: Reading and Writing Compressed Data

* Apply suggestions from code review

Co-authored-by: Nic <thisisnic@gmail.com>
* Rewording

* Rewording

* Update python/source/io.rst

Co-authored-by: Weston Pace <weston.pace@gmail.com>
Co-authored-by: Nic <thisisnic@gmail.com>
Co-authored-by: Weston Pace <weston.pace@gmail.com>
11 months agoAdd a basic dataset reading example (#85)
Weston Pace [Wed, 27 Oct 2021 20:46:20 +0000 (10:46 -1000)] 
Add a basic dataset reading example (#85)

* Added a basic dataset reading example

* Remove cmake debugging

* Adding newline to end of common.cc

* Apply suggestions from code review

Co-authored-by: Nic Crane <thisisnic@gmail.com>
Co-authored-by: Nic Crane <thisisnic@gmail.com>
11 months ago[R] 93 - dplyr chapter feedback (#94)
Nic [Tue, 26 Oct 2021 10:47:52 +0000 (13:47 +0300)] 
[R] 93 - dplyr chapter feedback (#94)

* Fix bullet points

* Ensure it's obvious arrow is doing the work

* chunks

11 months agoARROW-13730: Adding a column to an existing Table (#81)
Alessandro Molina [Thu, 21 Oct 2021 08:45:54 +0000 (10:45 +0200)] 
ARROW-13730: Adding a column to an existing Table (#81)

11 months agoARROW-13732: [Doc][Cookbook] Manipulating and analyze Arrow data with dplyr verbs...
Nic [Thu, 21 Oct 2021 08:37:44 +0000 (09:37 +0100)] 
ARROW-13732: [Doc][Cookbook] Manipulating and analyze Arrow data with dplyr verbs - R (#78)

* Update chapter to follow problem/solution/discussion format

* Split data manipulation chapter into tables/arrays and add initial content

* Remove assignment and have simpler chains

* Shorten line

* Add content on using compute functions not implemented in the R package

* Remove the word tidyverse as it's inaccurate

* Add heading

* Entirely refactor

* Add comment with current missing content

* Actually use Arrow

* Add "what you should know" section and do loads of rephrasing and adding examples

* Add "what you should know before, and content on calling functions directly

* Add test

* Rename files

* Add tests to code chunks

* Add note about collect/create

* Fix bad link

* Update r/content/arrays.Rmd

Co-authored-by: Weston Pace <weston.pace@gmail.com>
* Update r/content/arrays.Rmd

Co-authored-by: Weston Pace <weston.pace@gmail.com>
* Update r/content/arrays.Rmd

Co-authored-by: Weston Pace <weston.pace@gmail.com>
* Remove "where possible"

* Rephrase to clarify

* restyle

* More rephrasing

* Add some simpler intro content to the dplyr chapter

* Add tests for intro code

* Put dataset in Table$create() call

* Reduce whitespace

* Use arrow_table instead of Table$create

* Use Table$create for the moment while the next version isn't on CRAN yet

* Erroneous renaming

Co-authored-by: Weston Pace <weston.pace@gmail.com>
11 months agoARROW-13710: Arrow Flight recipe (#84)
Alessandro Molina [Wed, 13 Oct 2021 12:03:52 +0000 (14:03 +0200)] 
ARROW-13710: Arrow Flight recipe (#84)

* Flight RPC

* Create datasets directory

* comment

* Ops, forgot to create repo for real

* Size can change depending on the system

* Apply suggestions from code review

Co-authored-by: David Li <li.davidm96@gmail.com>
* Address code review feedbacks

Co-authored-by: David Li <li.davidm96@gmail.com>
11 months agoARROW-13753: Filtering Arrays for values matching a mask filter (#80)
Alessandro Molina [Fri, 8 Oct 2021 08:57:50 +0000 (10:57 +0200)] 
ARROW-13753: Filtering Arrays for values matching a mask filter (#80)

* filtering arrays recipe

* Wrong heading

* Apply suggestions from code review

Co-authored-by: Weston Pace <weston.pace@gmail.com>
Co-authored-by: Weston Pace <weston.pace@gmail.com>
12 months agoARROW-13751: Recipe for searching for values matching a predicate (#79)
Alessandro Molina [Tue, 5 Oct 2021 09:31:32 +0000 (11:31 +0200)] 
ARROW-13751: Recipe for searching for values matching a predicate (#79)

* Recipe for searching for values matching a predicate

* Apply suggestions from code review

Co-authored-by: Weston Pace <weston.pace@gmail.com>
* Wrong heading

Co-authored-by: Weston Pace <weston.pace@gmail.com>
12 months ago[R] - Schemas recipes (#67)
Nic [Fri, 1 Oct 2021 17:27:35 +0000 (17:27 +0000)] 
[R] - Schemas recipes (#67)

* Add the creating schemas recipe

* Add in content on combinig schemas, and specifying schemas when reading in files

* Delete unncecessary files, and stop showing test chunks

* Rephrase the bit about converting from R to Arrow

* Remove extraneous word

* Also mention reading in data

* Extra clarity

* missing word

* Add appendices

* Add section on casting, remove "problem" headings, update dataset, move tables to appendix, show example of incompatible data types

* Link between incompatible data types and appendix table

* Add content on combining schemas

* Rephrase

* Add context

* Reorder items in table

* Add recipe for schemas where match or don't match

* Rephrase

* Update code which causes an error to not run

* Relegate unify_schemas to discussion

* Fix rebase

* Remove appendix and link to vignette instead

* Remove examples of everything that could go wrong, as not relevant

* Fix failing test

12 months agoARROW-13727: Recipe to concatenate two tables (#76)
Alessandro Molina [Thu, 30 Sep 2021 14:19:08 +0000 (16:19 +0200)] 
ARROW-13727: Recipe to concatenate two tables (#76)

* Recipe to concatenate two tables

* Apply suggestions from code review

Co-authored-by: Nic <thisisnic@gmail.com>
Co-authored-by: Nic <thisisnic@gmail.com>
12 months agoUnify schemas recipe (#75)
Alessandro Molina [Thu, 30 Sep 2021 12:43:42 +0000 (14:43 +0200)] 
Unify schemas recipe (#75)

12 months agoAdd missing word (#77)
Nic [Mon, 20 Sep 2021 09:54:09 +0000 (09:54 +0000)] 
Add missing word (#77)

12 months agoUse as.data.frame instead of dplyr::collect (#71)
Nic [Wed, 15 Sep 2021 11:28:56 +0000 (11:28 +0000)] 
Use as.data.frame instead of dplyr::collect (#71)

* Use as.data.frame instead of dplyr::collect

* Typo

12 months agoARROW-13716: Add RecordBatch recipe (#66)
Alessandro Molina [Wed, 15 Sep 2021 11:26:16 +0000 (13:26 +0200)] 
ARROW-13716: Add RecordBatch recipe (#66)

* Add RecordBatch recipe

* Apply suggestions from code review

Co-authored-by: Weston Pace <weston.pace@gmail.com>
* Make example obvious

* Apply suggestions from code review

Co-authored-by: Nic <thisisnic@gmail.com>
Co-authored-by: Weston Pace <weston.pace@gmail.com>
Co-authored-by: Nic <thisisnic@gmail.com>
12 months agoSpecifying schemas for arrays and tables (#73)
Alessandro Molina [Wed, 15 Sep 2021 11:25:08 +0000 (13:25 +0200)] 
Specifying schemas for arrays and tables (#73)

12 months agoAdding anonymous flag to s3 (#70)
Tomek Drabas [Fri, 10 Sep 2021 23:46:18 +0000 (16:46 -0700)] 
Adding anonymous flag to s3 (#70)

* Adding anonymous flag to s3

* Fixing missing comma

* Info about s3 credentials

12 months agoCommitters automatically have all the permissions that collaborators do so this is...
Weston Pace [Thu, 9 Sep 2021 19:04:56 +0000 (09:04 -1000)] 
Committers automatically have all the permissions that collaborators do so this is no longer needed (congrats). (#69)

12 months agoARROW-13718: [Doc][Cookbook] Creating Arrays - R (#65)
Nic [Thu, 9 Sep 2021 16:38:34 +0000 (16:38 +0000)] 
ARROW-13718: [Doc][Cookbook] Creating Arrays - R (#65)

* Add recipe for creating an Array

12 months agoARROW-13709: Reading JSON in R recipe (#64)
Nic [Thu, 9 Sep 2021 16:38:09 +0000 (16:38 +0000)] 
ARROW-13709: Reading JSON in R recipe (#64)

* Ensure that test chunks are not rendered

* Add code to delete any temporarily generated files, add recipe for reading JSON

* Rephrase

12 months agoARROW-13717: Creating arrays recipe (#63)
Alessandro Molina [Tue, 7 Sep 2021 18:02:15 +0000 (20:02 +0200)] 
ARROW-13717: Creating arrays recipe (#63)

* Creating arrays recipe

* shorten pandas too for consistency

13 months agoAdded clang-tools (which includes clang-tidy) to environment.yml (#61)
Weston Pace [Wed, 1 Sep 2021 21:25:06 +0000 (11:25 -1000)] 
Added clang-tools (which includes clang-tidy) to environment.yml (#61)

* Added clang-tools (which includes clang-tidy) to environment.yml

* Added libstdc++ to the conda environment

* Only add clang flags if the compiler is clang

13 months agoCreating tables recipe (#51)
Alessandro Molina [Wed, 1 Sep 2021 14:38:35 +0000 (16:38 +0200)] 
Creating tables recipe (#51)

https://issues.apache.org/jira/browse/ARROW-13715

13 months agoRecipe to read line delimited json as of ARROW-13708 (#49)
Alessandro Molina [Wed, 1 Sep 2021 14:37:54 +0000 (16:37 +0200)] 
Recipe to read line delimited json as of ARROW-13708 (#49)

* Recipe to read json

* rename pj to pa.json

* Add colon