feat: add google cloud storage connector #746
ryannikolaidis
merged
38 commits into
main
from
potter/google-cloud-storage
fix incorrect pip install message
28d8d603
GCS initial changes that worked
43ef3bc4
Recursive file finder for GCS added
56e4399e
Small improvement
e2de1702
Improvements on gcs. Add recursive folder walking
2fa6fb58
Added requirements for Makefile etc...
0e229ef9
fixed comment
8825035e
fix small comment
639a5d99
fix small error
9eda17ae
add to manifest
8cf62428
fix conflict
79a47069
unfix conflict
eddc3855
ryannikolaidis
commented
on 2023-06-14
ryannikolaidis
commented
on 2023-06-14
ryannikolaidis
commented
on 2023-06-14
ryannikolaidis
commented
on 2023-06-14
ryannikolaidis
commented
on 2023-06-14
more improvements. still working on main.py though
a976fa73
replace drive recursive, local recurs w/ recursive
d0369a18
Added gcs token flag
612aa944
ran make tidy and make check
2284baf3
ryannikolaidis
commented
on 2023-06-16
ryannikolaidis
commented
on 2023-06-16
ryannikolaidis
commented
on 2023-06-16
ryannikolaidis
commented
on 2023-06-16
ryannikolaidis
commented
on 2023-06-16
ryannikolaidis
commented
on 2023-06-16
Add auth to gcs test. And fix comment
66a063cb
run tidy and check
40c6d77d
remove unwanted files
9c9b349a
Added strange azure file?
46aee8ed
un space strange azure file
902076f7
fix strange azure file that was pushed
07b85368
again with the same azure file
c3ce8d89
The file won't fix itself.
a9f48c0e
compile requirements
53a4cc88
bump cloud storage example repo
aeeb907c
update expected count to 6
fc9775e7
Merge branch 'main' into potter/google-cloud-storage
b58207c5
fix args
b45ddebd
fix access kwargs
d22df8e6
echo GCP_INGEST_SERVICE_KEY
959742ac
install gcs deps in ci
06bd0114
clean write the expected files
173eebe2
update local-recursive flag to recursive
11b69a72
Update ingest test fixtures (#788)
ad5282e8
Merge branch 'main' into potter/google-cloud-storage
da998412
bump changelog and version
d33f0de1
rename google-cloud to gcs everywhere for consistency
6f806afa
ryannikolaidis
changed the title
ryannikolaidis
approved these changes
on 2023-06-21
Login to write a write a comment.
Login via GitHub