Data Pipelines

Data pipelines are very important in dealing with big data. A data pipeline takes data from some source stream(s), processes this data and sends it to output stream(s). Codechef Beam is an example of such a pipeline. This pipeline takes data from $N_s$ source streams and it is expected to send data to $N_{oe}$ output streams. However, the actual number of output streams may be different. Interna