japgolly/clear-config
{ "createdAt": "2018-06-24T09:41:31Z", "defaultBranch": "master", "description": "Scala FP configuration library with a focus on runtime clarity", "fullName": "japgolly/clear-config", "homepage": null, "language": "Scala", "name": "clear-config", "pushedAt": "2026-06-20T02:55:19Z", "stargazersCount": 144, "topics": [ "config", "configuration", "fp", "functional-programming", "scala", "scala-js", "scalajs" ], "updatedAt": "2026-06-26T06:14:44Z", "url": "https://github.com/japgolly/clear-config"}ClearConfig
Section titled “ClearConfig”A type-safe, FP, Scala config library.
libraryDependencies += "com.github.japgolly.clearconfig" %%% "core" % "<ver>"What’s special about this?
Section titled “What’s special about this?”There are plenty of config libraries out there, right? This library is pure FP, type-safe, simple to use, highly composable, powerful, yada yada yada… All true but it’s biggest and most unique feature is actually:
CLARITY.
Haven’t we all had enough of situations like:
-
changing an environment variable setting, pushing all the way though to an environment, testing and then discovering that your expected change didn’t occur. Was the new setting picked up? What setting did it use? Where did it come from?
-
after hours of frustration: “That setting isn’t even used any more?! But it’s still in-place in all of our deployment config.”
This library endeavours to provide clarity. When you get an instance of your config, you also get a report that describes:
- where config comes from
- how config sources override other sources
- what values each config source provided
- what config keys are in use
- what the total, resulting config is
- which config is still hanging around but is actually stale and no longer in use
(sample reports below)
Walkthrough
Section titled “Walkthrough”Here’s a pretty common scenario that will serve as a decent introduction.
We have an app which has the following config:
import java.net.URL
final case class DatabaseConfig( port : Int, url : URL, username : String, password : String, schema : Option[String])Let’s define how we populate our config from the outside world…
import japgolly.clearconfig._import cats.implicits._
object DatabaseConfig {
def config: ConfigDef[DatabaseConfig] = ( ConfigDef.getOrUse("PORT", 8080), ConfigDef.need[URL]!("URL"), ConfigDef.need[String]!("USERNAME"), ConfigDef.need[String]!("PASSWORD"), ConfigDef.get[String]!("SCHEMA") ).mapN(apply)}Great, now let’s define where we want to read config from.
At this point you also need to decide which effect type to use.
You’d typically use something like IO but for simplicity,
we’ll just use Id and opt-out of safe FP.
import cats.Id
def configSources: ConfigSources[Id] = ConfigSource.environment[Id] > // Highest priority ConfigSource.propFileOnClasspath[Id]!("/database.props", optional = true) > // ConfigSource.system[Id] // Lowest priorityNow we’re ready to create a real instance based on the real environment.
val dbCfg: DatabaseConfig = DatabaseConfig.config .run(configSources) .getOrDie() // Just throw an exception if necessary config is missingDone! But so far we’re not using the most important feature of the library: the report.
Let’s get and print out a report at the end.
- We’ll remove env & system from unused keys to keep the report small seeing as it’s just a demo.
- We’ll also prefix all keys by
POSTGRES_to make it look a bit more realistic.
val (dbCfg, report) = DatabaseConfig.config .withPrefix("POSTGRES_") .withReport .run(configSources) .getOrDie() // Just throw an exception if necessary config is missing
println(report
// Only show unused env vars and properties that start with POSTGRES // (All unused keys in database.props will remain unfiltered in the report) .mapUnused(_.filterKeys(_.startsWith("POSTGRES"), ConfigSourceName.environment, ConfigSourceName.system))
// Show the full report .full)Sample output:
4 sources (highest to lowest priority): - Env - cp:/database.properties - System - Default
Used keys (5):+-------------------+------+-------------------------+---------+| Key | Env | cp:/database.properties | Default |+-------------------+------+-------------------------+---------+| POSTGRES_PASSWORD | | Obfuscated (1C02B9F6) | || POSTGRES_PORT | 4000 | | 8080 || POSTGRES_SCHEMA | | | || POSTGRES_URL | | http://localhost/blah | || POSTGRES_USERNAME | | demo | |+-------------------+------+-------------------------+---------+
Unused keys (1):+----------------+-------------------------+| Key | cp:/database.properties |+----------------+-------------------------+| POSTGRES_SCHMA | public |+----------------+-------------------------+From the above report we can immediately observe the following:
- Which sources override other sources; the report columns (left-to-right) respect this
- We’ll be running at port 4000 instead of the default because there’s an override set by the environment
- There’s a typo in our
database.properties;POSTGRES_SCHMAshould bePOSTGRES_SCHEMA - The password value has been hashed for the report. This still allows you to compare the hash between envs or time to determine change without compromising the value
-
Simplest and most common methods:
// gets value of Option[A] if key is specified, else returns NoneConfigDef.get[A]!(key: String)// gets value of A if key is specified, else parses a default string into an AConfigDef.getOrParse[A]!(key: String, default: String)// gets value of A if key is specified, else uses a default AConfigDef.getOrUse[A]!(key: String, default: A)// gets value of A if key is specified, else generates an errorConfigDef.need[A]!(key: String) -
To define your own type of config value, create an implicit
ConfigValueParser. Example:sealed trait MyBoolcase object Yes extends MyBoolcase object No extends MyBoolimplicit val myBoolParser: ConfigValueParser[MyBool] =ConfigValueParser.oneOf[MyBool]!("yes" -> Yes, "no" -> No).preprocessValue(_.toLowerCase) // Make it case-insensitive -
Call
.secreton yourConfigDefto force it to be obfuscated in the report. The default (implicit) report settings already obfuscate keys that contain substrings likepassword,credential, andsecret. OverrideconfigReportSettingsif required. -
Shell-style Comments (beginning with
#) are automatically removed from config values. Create your own implicitConfigValuePreprocessorto customise this behaviour. -
Keys can be modified after the fact. Eg.
ConfigDef.get("A").withPrefix("P_").withKeyMod(_.replace('_', '.'))is equivalent toConfigDef.get("P.A"). This also works when aConfigDefis a composition of more than one key, in which case they’ll all be modified. -
There is special DSL to create
A => Unitfunctions to configure a mutable object (which you typically use when working with a Java library)ConfigDef.consumerFn[A]!(...). There is an example below. -
ConfigDef.logbackXmlOnClasspathcan be used to parse logback xml for its use of environment variables so that they appear in config reports -
More… (explore the source)
Larger Example
Section titled “Larger Example”You typically compose using Applicative, give the composite a prefix,
then use (nest) it in some higher-level config.
For example, this Scala code…
import cats.syntax.apply._import japgolly.clearconfig._import java.net.{URI, URL}import redis.clients.jedis.JedisPoolConfig
case class AppConfig(postgres: PostgresConfig, redis: RedisConfig, logLevel: LogLevel)
object AppConfig { def config: ConfigDef[AppConfig] = ( PostgresConfig.config, RedisConfig.config, ConfigDef.getOrUse("log_level", LogLevel.Info) ).mapN(apply) .withPrefix("myapp.")}
case class PostgresConfig(url: URL, credential: Credential, schema: Option[String])
object PostgresConfig { def config: ConfigDef[PostgresConfig] = ( ConfigDef.need[URL]!("url"), Credential.config, ConfigDef.get[String]!("schema"), ).mapN(apply) .withPrefix("postgres.")}
case class Credential(username: String, password: String)
object Credential { def config: ConfigDef[Credential] = ( ConfigDef.need[String]!("username"), ConfigDef.need[String]!("password"), ).mapN(apply)}
case class RedisConfig(uri: URI, credential: Credential, configurePool: JedisPoolConfig => Unit)
object RedisConfig {
def poolConfig: ConfigDef[JedisPoolConfig => Unit] = ConfigDef.consumerFn[JedisPoolConfig]!( _.get("block_when_exhausted", _.setBlockWhenExhausted), _.get("eviction_policy_class_name", _.setEvictionPolicyClassName), _.getOrUse("fairness", _.setFairness)(true), _.get("jmx_enabled", _.setJmxEnabled), _.get("jmx_name_base", _.setJmxNameBase), _.get("jmx_name_prefix", _.setJmxNamePrefix), _.get("lifo", _.setLifo), _.get("max_idle", _.setMaxIdle), _.get("max_total", _.setMaxTotal), _.get("max_wait_millis", _.setMaxWaitMillis), _.get("min_evictable_idle_time_millis", _.setMinEvictableIdleTimeMillis), _.getOrUse("min_idle", _.setMinIdle)(2), _.get("num_tests_per_eviction_run", _.setNumTestsPerEvictionRun), _.get("soft_min_evictable_idle_time_millis", _.setSoftMinEvictableIdleTimeMillis), _.get("test_on_borrow", _.setTestOnBorrow), _.get("test_on_create", _.setTestOnCreate), _.get("test_on_return", _.setTestOnReturn), _.get("test_while_idle", _.setTestWhileIdle), _.get("time_between_eviction_runs_millis", _.setTimeBetweenEvictionRunsMillis) )
def config: ConfigDef[RedisConfig] = ( ConfigDef.need[URI]!("uri"), Credential.config, poolConfig.withPrefix("pool."), ).mapN(apply) .withPrefix("redis.")}
sealed trait LogLevelobject LogLevel { case object Debug extends LogLevel case object Info extends LogLevel case object Warn extends LogLevel
implicit def configValueParser: ConfigValueParser[LogLevel] = ConfigValueParser.oneOf[LogLevel]!("debug" -> Debug, "info" -> Info, "warn" -> Warn) .preprocessValue(_.toLowerCase)}will read the following properties:
myapp.postgres.passwordmyapp.postgres.schemamyapp.postgres.urlmyapp.postgres.username
myapp.redis.passwordmyapp.redis.urimyapp.redis.username
myapp.redis.pool.block_when_exhaustedmyapp.redis.pool.eviction_policy_class_namemyapp.redis.pool.fairnessmyapp.redis.pool.jmx_enabledmyapp.redis.pool.jmx_name_basemyapp.redis.pool.jmx_name_prefixmyapp.redis.pool.lifomyapp.redis.pool.max_idlemyapp.redis.pool.max_totalmyapp.redis.pool.max_wait_millismyapp.redis.pool.min_evictable_idle_time_millismyapp.redis.pool.min_idlemyapp.redis.pool.num_tests_per_eviction_runmyapp.redis.pool.soft_min_evictable_idle_time_millismyapp.redis.pool.test_on_borrowmyapp.redis.pool.test_on_createmyapp.redis.pool.test_on_returnmyapp.redis.pool.test_while_idlemyapp.redis.pool.time_between_eviction_runs_millis
myapp.log_levelJava version
Section titled “Java version”There is a Java version of this library here: https://github.com/japgolly/clear-config-java
Support:
Section titled “Support:”If you like what I do —my OSS libraries, my contributions to other OSS libs, my programming blog— and you’d like to support me, more content, more lib maintenance, please become a patron! I do all my OSS work unpaid so showing your support will make a big difference.