Enterprise Monitoring Solutions Engineer, Splunk II

US-GA-Atlanta | US-Florida


Leveraging deep integrations into retailers’ point-of-sale systems, InComm provides connectivity to a variety of service providers that allow consumers to conduct everyday business at more than 450,000 points of retail distribution worldwide. Whether those consumers are activating prepaid products, paying bills, enjoying real-time discounts through a membership card, purchasing digital goods in-store or adding funds to an online account, InComm is there to provide unique gift-gifting opportunities, cater to on-the-go shoppers, deliver added value through loyalty programs and serve cash-based consumers. With 186 global patents, InComm is headquartered in Atlanta with a presence in over 30 countries in North and South America, Europe and the Asia-Pacific region. Learn more at or connect with us on,, or


About This Opportunity

The Splunk Administrator provides support for the large-scale Splunk environment at InComm.  This includes architect and design of the Splunk environment, to handle the large workload it is used for here.  It includes performance monitoring of the Splunk environment, to make sure that there are no bottlenecks, and if any are found that they can be addressed.  The Splunk Administrator works with the Splunk vendor on recommendations and solutions to issues in our environment.  This position should understand Splunk concepts from reporting all the way to cluster and site configuration and should be familiar with all of the important configurations inside of Splunk Enterprise, so that these complex configurations can be used to fine tune our environment and maximize performance of the product.


This role requires an in depth knowledge of Splunk, storage technologies, virtualization techniques, Linux servers, and general server performance concepts.




  • Produce enterprise-level designs for Splunk, for global initiatives (i.e. data center migration), and following those designs through to implementation via collaboration with project, support, and infrastructure teams.
  • Identify opportunities to innovate, extend and enhance service delivery within Splunk, where possible.
  • Own Root Cause Analysis and Problem Management for corporate Splunk environment.
  • Serve as escalation point for application support and troubleshooting, using Splunk data. Provides guidance and direction in resolution of escalated issues and/or complex production, application or system problems.
  • Serves as the first line of escalation support for Splunk issues that cannot be resolved by tier one and two Splunk support.
  • Perform daily system monitoring, verifying the integrity and availability of all hardware, server resources, systems and key processes for the Splunk environment, reviewing system logs and consoles, and any error logs
  • Install, configure, and maintain Splunk and third party apps for Splunk within company operational guidelines.  This includes periodic upgrades to the Splunk environment, as well as testing the upgrade process.
  • Work with other teams, specifically Network and Security and Application Support, to make sure that all necessary logs are sent into Splunk, and all necessary alerts and reports are defined
  • Create and maintain system documentation for Splunk, including forwarder installation, configuration, and appropriate troubleshooting steps.
  • Improve existing processes through solutions to recurring problems and enhancements to existing solutions or documentation.
  • Provide training as required
  • Manage customer satisfaction through effectively communicating and managing customer expectations


Basic Qualifications:

  • B.S. degree in a computer science, information technology, computer related discipline or 5+ years IT work experience in a global information technology infrastructure environment.


Preferred Skills/Experience: 

  • Experience working with Splunk at the Administrator level, including design/architecture skills
  • Expert knowledge in Linux server usage (command line, performance, etc).
  • Expert knowledge of syslog process for other devices sending in syslog
  • Extensive experience in storage technologies, with the knowledge in performance, capacity, and usage of the different technologies
  • Extensive experience in networking, with the ability to understand and troubleshoot network issues as they relate to the Splunk environment...
  • Experience in ITIL preferred, knowledge in IT Service Management required.
  • Develops, documents, and enforces the standards, security procedures, and controls for access to ensure integrity of the Splunk environment and the data contained within.
  • Knowledge of server virtualization technologies, preferably VMware and/or Microsoft technologies


Professional Skills/Experience:

  • Minimum 10 years overall IT experience with 3-5 years of experience working with Splunk.
  • Must show a progressive advancement in responsibility including deep troubleshooting technical skills.
  • Must have an understanding of how to identify and instill industry best practices.
  • Ability to translate technical issues into understandable business language for end users.
  • Team Player with proven leadership, communication, organizational, and strong interpersonal skills. The role requires significant interaction with many different teams across a global company.
  • Must be able to work in a team environment with a “can do” attitude capable of overcoming difficult challenges.
  • Self-motivated, with keen attention to detail and excellent judgment skills
  • Ability to establish new standards for quality, performance or productivity
  • Must have excellent writing and communication skills, strong communicator with ability to maintain open communication with internal employees, contractors, managers, 3rd parties, and customers as needed
  • Able to integrate and apply feedback in a professional manner
  • Able to prioritize and drive to results with a high emphasis on quality



InComm provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, sexual orientation, gender identity or national origin, citizenship, veteran’s status, age, disability status, genetics or any other category protected by federal, state, or local law.


*This position is eligible for the Employee Referral Bonus Program #LI-TH1



Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
Share on your newsfeed