aws.s3 in R
Hi,
Apologies if this is the wrong place to post - I can’t find any resources online that seem to cover this issue.
I’m using aws.s3 package in R, to read in files from a LakeFS storage area.
When I use s3read_using or s3write_using, the connectivity works. The functions include (e.g.):
S3read_using(FUN = read.csv,
Object = path/file.csv,
Opts = …,
Bucket = my_repo)
This works fine and I am able to read in the object, same goes for writing using same opts.
However, when I try and run for example head_object (so I can list the objects contained in one of my buckets) or get_object, I get :
error in curl::curl_fetch_memory(url, handle = handle):
Could not resolve hostname
Could not resolve host: [path]
I’m not sure if I’m missing something simple - I’m using the exact same repo, opts, and object (/paths) for both. The [path] here looks correct - I don’t see any issues with it. Does something happen within s3read_using where it points to a location that I need to specify myself with in head_object? Should they not be pointing to the same place?
Again sorry if this is hard to follow or make sense of, I just can’t seem to find anything online relating to this problem or solutions.
Thanks