Different .ebextensions depending on environment

Question

I have 2 separate environments to manage my application, a primary env, webserver with a load balancer, and a secondary env, a single small tier worker to run crons.

My .ebextensions contains a lot of Instance and load balancer configurations, example:

01amazon.config

Resources:
  # LB SG
  AWSEBLoadBalancerSecurityGroup:
    Type: "AWS::EC2::SecurityGroup"
    Properties:
....

Is there any way to ignore this single file when i deploy to my worker instance via eb deploy worker-env

If the file is not ignored, it causes an error, due to the worker not having a load balancer.