Skip to content

Tips for working with large datasets #264

Description

@laijasmine

Complementing #259

  • Create a central table for all the attributes across all datasets and either use filter or left_join to refine what is needed

  • Use references

  • use relevant parts of the file name to help construct a description using dplyr::case_when , tools::file_path_sans_ext(), and stringr::str_extract

  • use selectMember to help you grab the correct pids to use
    eg. zipId <- selectMember(dp, name="sysmeta@formatId", value="application/vnd.shp+zip")

  • use for loops or purrr::map to help iterate through entities

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions