How to generate a Flat file with header and footer

问题:

Currently I'm able to generate a flat file from a POJO using camel Bindy but unable to add header and Footer to the complete file.

But when I tried to add header/footer to the file, it is adding to each single record but I need to add a single header/footer to the complete file not each record in the file.

Below is the code snippet:

from("jpa:com.PACKAGENAME.RebatePayout?consumer.namedQuery=REBATE_PAYOUT&consumer.delay=500000&consumeLockEntity=true&consumeDelete=false")
    .routeId("rebateroute")
    .process(new Processor() {
        RebateOutputgenerator rop = new RebateOutputgenerator();
                @Override
                public void process(Exchange exchange) throws Exception {
                    exchange.getIn().setBody(rop.processEntities((RebatePayout) exchange.getIn().getBody()));
                    log.info("the exchange value is ", exchange);                         
                }
        })
        .process(new FahHeaderAndFooterHelper())
        .log("Fixed length format marshal....")
        .marshal(fixedLegth)
        .log("Fixed length format data....${body}")
        .to("file://C:/Users/vvakalap/Desktop/example/New folder?fileExist=Append&fileName=output.txt")
        .log("Data Saved in file...");

Process class is

public class FahHeaderAndFooterHelper implements Processor{
    @Override
    public void process(Exchange exchange) throws Exception {
        Map<String, Object> headerObjMap = new HashMap<String,Object>();
        headerObjMap.put(FahRecordHeader.class.getName(), new FahRecordHeader());
        if(exchange.getOut().getBody() == "null")
            exchange.getOut().setHeader(CAMEL_BINDY_FIXED_LENGTH_HEADER, headerObjMap);
        Map<String, Object> footerObjMap = new HashMap<String,Object>();
        footerObjMap.put(FahRecordFooter.class.getName(), new FahRecordFooter());
        exchange.getOut().setHeader(CAMEL_BINDY_FIXED_LENGTH_FOOTER, footerObjMap);
        exchange.getOut().setBody(exchange.getIn().getBody());
    }

POJO Class

@Data
@Section(number=2)
@FixedLengthRecord(header = FahRecordHeader.class, footer = FahRecordFooter.class)
public class RebateFinalRecord implements Serializable {

    private static final long serialVersionUID = 7375828620208233805L;

    @DataField(pos = 1, length = 3)
    private String transactionRecordIdentifier;

    @DataField(pos = 4, length = 10)
    private String transactionNumber;

    @DataField(pos = 14, length = 5)
    private String transactionLineNumber;

    @DataField(pos = 19, length = 20)
    private String transactionDistributionType;

    @DataField(pos = 39, length = 30)
    private String eventTypeName;

    @DataField(pos = 69, length = 8)
    private String transactionDate;

    @DataField(pos = 77, length = 8)
    private String transactionEffectiveDate;

    @DataField(pos = 85, length = 5)
    private String transactingEntityValue;

    @DataField(pos = 90, length = 1)
    private String reciprocationFlag;

}

Bindy class

@Data
public class FahRecordHeader {
    @DataField(pos = 1, length = 3)
    private String fileRecordIdentifier = "000";
    @DataField(pos = 4, length = 15)
    private String controlIdentifierOrSequenceNumber = "LSCD00000000006";
    @DataField(pos = 19, length = 20)
    private String source = "LSCD";
}

@Data
public class FahRecordFooter {

    @DataField(pos = 1, length = 70)
    private String footer = "footervalusforfahrecord for cashrebates";
    /*
     * @DataField(pos = 2, length = 9, align = "R", paddingChar = '0')
     * private int numberOfRecordsInTheFile;
     */
}

回答1:

Did you try setting the hasHeader and hasFooter attributes of the @FixedLengthRecord to true?

@FixedLengthRecord(header = FahRecordHeader.class, 
                   footer = FahRecordFooter.class, 
                   hasHeader = true, 
                   hasFooter = true)

See https://camel.apache.org/bindy.html#Bindy-4.FixedLengthRecord.

回答2:

This is after a long time, but maybe it can still help.

You can add in your FahHeaderAndFooterHelper conditions when to add the CAMEL_BINDY_FIXED_LENGTH_HEADER and CAMEL_BINDY_FIXED_LENGTH_FOOTER headers.

For example if the file does not exist or is empty for the header and some condition when your file is considered complete for the footer.

回答3:

Create a helper method which returns all declared fields of your MyClass :

import java.lang.reflect.Field

class AnnotationUtil {

    public static Field[] getDeclaredFields(Class clazz, boolean recursively) {
        List<Field> fields = new LinkedList<Field>();
        Field[] declaredFields = clazz.getDeclaredFields();
        Collections.addAll(fields, declaredFields);

        Class superClass = clazz.getSuperclass();

        if(superClass != null && recursively) {
            Field[] declaredFieldsOfSuper = getDeclaredFields(superClass, recursively);
            if(declaredFieldsOfSuper.length > 0)
                Collections.addAll(fields, declaredFieldsOfSuper);
        }

        return fields.toArray(new Field[fields.size()]);
    }
}

@CsvRecord(separator = "|",  generateHeaderColumns = false)
class MyClass {

    @DataField(pos = 1, columnName = "Column1")
    String orderName;

    @DataField (pos = 2, columnName = "Column2")
    String transactionId
}

Then create a processor:

import org.apache.camel.Exchange;
import org.apache.camel.Processor;
import org.apache.camel.dataformat.bindy.annotation.DataField;
import org.springframework.stereotype.Component;

import java.io.File;
import java.nio.file.Files;
import java.nio.file.Paths;
import java.util.Arrays;
import java.util.stream.Collectors;

@Component
class CSVHeaderProcessor implements Processor{
    @Override
    public void process(Exchange exchange) throws Exception {
       String fullFilePath = (String) exchange.getIn().getHeader("CSV_FILE_LOCATION");
        String header;
        File csvFile = new File(fullFilePath);

        if(!csvFile.exists()) {
            String headerRow = Arrays.stream((AnnotationUtil.getDeclaredFields(YourClass.class, false))).map(x -> x.getAnnotation(DataField.class).columnName()).collect( Collectors.joining( "," ));
            Files.write(Paths.get(csvFile.getPath()), headerRow.getBytes());
        }

    }
}

Then use it in your route as such:

 from("direct:handleCSV")
     .setHeader("CSV_FILE_LOCATION", simple("/tmp/yourfile.csv"))
     .process(csvHeaderProcessor)
     .marshal(bindy)
 .to("file:///tmp?fileName=yourfile.csv&fileExist=append")