Software Engineer/Developer - Midlevel (Hybrid- Philadelphia, PA)

Software Engineer/Developer - Midlevel (Hybrid- Philadelphia, PA)

We are looking to hire a candidate with the skills sets mentioned and experience for one of our clients within the oil/gas industry. This is a Hybrid role in Philadelphia, PA, with a minimum of 3 days in the office.

Position Summary/Key Responsibilities:

Security & Governance

Understanding of data privacy, air-gapped deployments, and enterprise security requirements.

Experience implementing access controls and audit logging.

Deliverables

Reference architecture and deployment guidance.

Working prototype (LLM + vector DB + RAG).

Documentation and knowledge transfer to internal teams.

Required Experience/Skills/Education:

On-Prem LLM & Vector DB Implementation

Practical experience with open-source vector databasessuch as Qdrant, Chroma, Milvus, or 

Proven implementation of Retrieval-Augmented Generation (RAG)

Experience generating and managing embeddingsand metadata filtering.

Hands-on experience deploying open-source LLMssuch as Meta Llama 3 and Mistral / Mixtral in on-prem or private environments.

Strong proficiency in Pythonfor LLM inference, prompt engineering, and integration.

Experience with CPU-based inference, model quantization, and performance tuning.

Experience with LangChain or LlamaIndex.

Exposure to Rust, Go, or C++ for high-performance services.

Familiarity with Docker and Kubernetes for on-prem deployments.

Knowledge of inference frameworks (e.g., vLLM, llama.cpp, Hugging Face Transformers).

Prior work in regulated or enterprise environments.

Other Job Specifications:

Employment Type: W2 only. NO C2C, NO Visa candidates.

Contracting Period: 12+ months contracting opportunity with the potential for extension.

Job Location: Hybrid - Philadelphia, PA (minimum 3 days in the office).

Contract Rate: $55 - $58/hr. on W2.

Interview Process: 2 rounds of in-person onsite interviews (1 hour each).