swh:1:snp:764524290233376de64947417267228741ce2485
Revision 1feb85f4eadcfdf5743ce26b106685bd1dd11d5e authored by Charles Gao on 21 July 2017, 19:20:06 UTC, committed by gaojieliu on 21 July 2017, 21:04:28 UTC
Currently the Voldemort Build and Push (BnP) plugin tells Voldemort
cluster to fetch twice from the source HDFS cluster.
This optional CDN feature will instead copy files to dedicated CDN
clusters, and therefore reduce bandwidth requirement for the source.

The following are new attributes that are related to this release:
1. push.cdn.enabled
    The global switch.
    Example: true
    Default: false

2. push.cdn.cluster
    A list of "destination|cdn" pairs separated by comma, where "destination"
    is a Voldemort cluster, and "cdn" is the corresponding HDFS cluster used
    as CDN. if "cdn" is "null", V-cluster will fetch directly from the source
    HDFS cluster instead, in which case the behavior is identical to the
    previous versions of Voldemort.
    Example: tcp://v-cluster1:6666|hdfs://cdn1:9000,tcp://v-cluster2:6666|webhdfs://cdn2:50070,tcp://v-cluster3:6666|null
    Default: null

3. push.cdn.prefix
    A directory on the CDN cluster as the root for all distcp copied files.
    Example: /jobs/VoldemortBnP
    Default: null

4. push.cdn.readByGroup
    Set true if CDN files are read by a different user in the same group.
    Example: true
    Default: true

5. push.cdn.readByOther
    Set true if CDN files are read by a different user in a different group.
    Example: true
    Default: true

6. push.cdn.writtenByGroup
    Set true if CDN files are written by a different user in the same group.
    Example: true
    Default: true

7. push.cdn.writtenByOther
    Set true if CDN files are written by a different user in a different group.
    Example: true
    Default: true

8. push.cdn.storeWhitelist
    A comma-separated list of Voldemort store names to which the CDN feature will
    apply. (for testing purposes)
    Default: null (means apply to every store)

This release is compatible with existing job configurations. The default
behavior is identical to the previous version.
1 parent 3787b4f
History
Tip revision: 99127eab3078eed90faa66cc671259a85cb89464 authored by Felix GV on 24 July 2023, 13:49:47 UTC
Update README.md
Tip revision: 99127ea
File Mode Size
.settings
bin
clients
config
contrib
docs
example
gobblin
gradle
src
test
voldemort-contrib
voldemort-protobuf
.gitignore -rw-r--r-- 242 bytes
CONTRIBUTORS -rw-r--r-- 659 bytes
LICENSE -rw-r--r-- 11.1 KB
NOTES -rw-r--r-- 2.5 KB
NOTICE -rw-r--r-- 8.1 KB
README.md -rw-r--r-- 4.7 KB
build.gradle -rw-r--r-- 22.6 KB
build.xml -rw-r--r-- 1.7 KB
gradle.properties -rw-r--r-- 1.1 KB
gradlew -rwxr-xr-x 4.9 KB
gradlew.bat -rw-r--r-- 2.3 KB
release_notes.txt -rw-r--r-- 52.5 KB
settings.gradle -rw-r--r-- 646 bytes
tomcat-tasks.properties -rw-r--r-- 420 bytes
web.xml -rw-r--r-- 1.1 KB

README.md

back to top