MoveRawObsStep

You should not generally have to use this step!

This step moves observations from the raw directory to a flattened directory per-filter. This just simplifies finding files going forwards in the pipeline.

API

class pjpipe.MoveRawObsStep(target, band, step_ext, in_dir, out_dir, dr_version, is_bgr, obs_to_skip=None, extra_obs_to_include=None, overwrite=False)[source]

Move raw observations from the MAST folder into a specific target/band folder

Because we may want to pull files for science images but not for backgrounds, they can be distinguished at the config level, as:

[parameters.move_raw_obs.extra_obs_to_include]
ic5332.sci.ngc7496 = 'jw02107041001_0?2'

where you can use ‘sci’ or ‘bgr’ to distinguish. To include in either case, just omit this part.

Parameters:

  • target – Target to consider

  • band – Band to consider

  • step_ext – .fits extension to look for (e.g. uncal, rate etc.)

  • in_dir – Input directory to search for files (should be some kind of mastDownload-esque folder)

  • out_dir – Where to move files to

  • dr_version – Data reprocessing version

  • is_bgr – Whether we’re processing background observations or not

  • obs_to_skip – List of failed or otherwise observations that shouldn’t be moved. Defaults to None, which skips nothing

  • extra_obs_to_include – List of extra observations to include, for example MIRI flats from elsewhere. Defaults to None, which includes nothing extra

  • overwrite (bool) – Whether to overwrite or not. Defaults to False

do_step()[source]

Move raw observation files

get_raw_files()[source]

Build a list of raw files

move_raw_files(raw_files)[source]

Actually move the raw files