1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287
|
// Copyright 2014 The Chromium Authors. All rights reserved.
// Use of this source code is governed by a BSD-style license that can be
// found in the LICENSE file.
#include "chrome/browser/extensions/api/storage/sync_storage_backend.h"
#include "base/files/file_enumerator.h"
#include "base/logging.h"
#include "chrome/browser/extensions/api/storage/settings_sync_processor.h"
#include "chrome/browser/extensions/api/storage/settings_sync_util.h"
#include "chrome/browser/extensions/api/storage/syncable_settings_storage.h"
#include "content/public/browser/browser_thread.h"
#include "sync/api/sync_error_factory.h"
using content::BrowserThread;
namespace extensions {
namespace {
void AddAllSyncData(const std::string& extension_id,
const base::DictionaryValue& src,
syncer::ModelType type,
syncer::SyncDataList* dst) {
for (base::DictionaryValue::Iterator it(src); !it.IsAtEnd(); it.Advance()) {
dst->push_back(settings_sync_util::CreateData(
extension_id, it.key(), it.value(), type));
}
}
} // namespace
SyncStorageBackend::SyncStorageBackend(
const scoped_refptr<SettingsStorageFactory>& storage_factory,
const base::FilePath& base_path,
const SettingsStorageQuotaEnforcer::Limits& quota,
const scoped_refptr<SettingsObserverList>& observers,
syncer::ModelType sync_type,
const syncer::SyncableService::StartSyncFlare& flare)
: storage_factory_(storage_factory),
base_path_(base_path),
quota_(quota),
observers_(observers),
sync_type_(sync_type),
flare_(flare) {
DCHECK_CURRENTLY_ON(BrowserThread::FILE);
DCHECK(sync_type_ == syncer::EXTENSION_SETTINGS ||
sync_type_ == syncer::APP_SETTINGS);
}
SyncStorageBackend::~SyncStorageBackend() {}
ValueStore* SyncStorageBackend::GetStorage(const std::string& extension_id) {
DCHECK_CURRENTLY_ON(BrowserThread::FILE);
base::DictionaryValue empty;
return GetOrCreateStorageWithSyncData(extension_id, empty);
}
SyncableSettingsStorage* SyncStorageBackend::GetOrCreateStorageWithSyncData(
const std::string& extension_id,
const base::DictionaryValue& sync_data) const {
DCHECK_CURRENTLY_ON(BrowserThread::FILE);
StorageObjMap::iterator maybe_storage = storage_objs_.find(extension_id);
if (maybe_storage != storage_objs_.end()) {
return maybe_storage->second.get();
}
scoped_ptr<SettingsStorageQuotaEnforcer> storage(
new SettingsStorageQuotaEnforcer(
quota_, storage_factory_->Create(base_path_, extension_id)));
// It's fine to create the quota enforcer underneath the sync layer, since
// sync will only go ahead if each underlying storage operation succeeds.
linked_ptr<SyncableSettingsStorage> syncable_storage(
new SyncableSettingsStorage(
observers_, extension_id, storage.release(), sync_type_, flare_));
storage_objs_[extension_id] = syncable_storage;
if (sync_processor_.get()) {
syncer::SyncError error = syncable_storage->StartSyncing(
sync_data, CreateSettingsSyncProcessor(extension_id).Pass());
if (error.IsSet())
syncable_storage.get()->StopSyncing();
}
return syncable_storage.get();
}
void SyncStorageBackend::DeleteStorage(const std::string& extension_id) {
DCHECK_CURRENTLY_ON(BrowserThread::FILE);
// Clear settings when the extension is uninstalled. Leveldb implementations
// will also delete the database from disk when the object is destroyed as a
// result of being removed from |storage_objs_|.
//
// TODO(kalman): always GetStorage here (rather than only clearing if it
// exists) since the storage area may have been unloaded, but we still want
// to clear the data from disk.
// However, this triggers http://crbug.com/111072.
StorageObjMap::iterator maybe_storage = storage_objs_.find(extension_id);
if (maybe_storage == storage_objs_.end())
return;
maybe_storage->second->Clear();
storage_objs_.erase(extension_id);
}
std::set<std::string> SyncStorageBackend::GetKnownExtensionIDs() const {
DCHECK_CURRENTLY_ON(BrowserThread::FILE);
std::set<std::string> result;
// Storage areas can be in-memory as well as on disk. |storage_objs_| will
// contain all that are in-memory.
for (StorageObjMap::iterator it = storage_objs_.begin();
it != storage_objs_.end();
++it) {
result.insert(it->first);
}
// Leveldb databases are directories inside |base_path_|.
base::FileEnumerator extension_dirs(
base_path_, false, base::FileEnumerator::DIRECTORIES);
while (!extension_dirs.Next().empty()) {
base::FilePath extension_dir = extension_dirs.GetInfo().GetName();
DCHECK(!extension_dir.IsAbsolute());
// Extension IDs are created as std::strings so they *should* be ASCII.
std::string maybe_as_ascii(extension_dir.MaybeAsASCII());
if (!maybe_as_ascii.empty()) {
result.insert(maybe_as_ascii);
}
}
return result;
}
syncer::SyncDataList SyncStorageBackend::GetAllSyncData(syncer::ModelType type)
const {
DCHECK_CURRENTLY_ON(BrowserThread::FILE);
// Ignore the type, it's just for sanity checking; assume that whatever base
// path we're constructed with is correct for the sync type.
DCHECK(type == syncer::EXTENSION_SETTINGS || type == syncer::APP_SETTINGS);
// For all extensions, get all their settings. This has the effect
// of bringing in the entire state of extension settings in memory; sad.
syncer::SyncDataList all_sync_data;
std::set<std::string> known_extension_ids(GetKnownExtensionIDs());
for (std::set<std::string>::const_iterator it = known_extension_ids.begin();
it != known_extension_ids.end();
++it) {
ValueStore::ReadResult maybe_settings =
GetOrCreateStorageWithSyncData(*it, base::DictionaryValue())->Get();
if (maybe_settings->HasError()) {
LOG(WARNING) << "Failed to get settings for " << *it << ": "
<< maybe_settings->error().message;
continue;
}
AddAllSyncData(*it, maybe_settings->settings(), type, &all_sync_data);
}
return all_sync_data;
}
syncer::SyncMergeResult SyncStorageBackend::MergeDataAndStartSyncing(
syncer::ModelType type,
const syncer::SyncDataList& initial_sync_data,
scoped_ptr<syncer::SyncChangeProcessor> sync_processor,
scoped_ptr<syncer::SyncErrorFactory> sync_error_factory) {
DCHECK_CURRENTLY_ON(BrowserThread::FILE);
DCHECK_EQ(sync_type_, type);
DCHECK(!sync_processor_.get());
DCHECK(sync_processor.get());
DCHECK(sync_error_factory.get());
sync_processor_ = sync_processor.Pass();
sync_error_factory_ = sync_error_factory.Pass();
// Group the initial sync data by extension id.
std::map<std::string, linked_ptr<base::DictionaryValue> > grouped_sync_data;
for (syncer::SyncDataList::const_iterator it = initial_sync_data.begin();
it != initial_sync_data.end();
++it) {
SettingSyncData data(*it);
linked_ptr<base::DictionaryValue> sync_data =
grouped_sync_data[data.extension_id()];
if (!sync_data.get()) {
sync_data =
linked_ptr<base::DictionaryValue>(new base::DictionaryValue());
grouped_sync_data[data.extension_id()] = sync_data;
}
DCHECK(!sync_data->HasKey(data.key())) << "Duplicate settings for "
<< data.extension_id() << "/"
<< data.key();
sync_data->SetWithoutPathExpansion(data.key(), data.value().DeepCopy());
}
// Start syncing all existing storage areas. Any storage areas created in
// the future will start being synced as part of the creation process.
for (StorageObjMap::iterator it = storage_objs_.begin();
it != storage_objs_.end();
++it) {
std::map<std::string, linked_ptr<base::DictionaryValue> >::iterator
maybe_sync_data = grouped_sync_data.find(it->first);
syncer::SyncError error;
if (maybe_sync_data != grouped_sync_data.end()) {
error = it->second->StartSyncing(
*maybe_sync_data->second,
CreateSettingsSyncProcessor(it->first).Pass());
grouped_sync_data.erase(it->first);
} else {
base::DictionaryValue empty;
error = it->second->StartSyncing(
empty, CreateSettingsSyncProcessor(it->first).Pass());
}
if (error.IsSet())
it->second->StopSyncing();
}
// Eagerly create and init the rest of the storage areas that have sync data.
// Under normal circumstances (i.e. not first-time sync) this will be all of
// them.
for (std::map<std::string, linked_ptr<base::DictionaryValue> >::iterator it =
grouped_sync_data.begin();
it != grouped_sync_data.end();
++it) {
GetOrCreateStorageWithSyncData(it->first, *it->second);
}
return syncer::SyncMergeResult(type);
}
syncer::SyncError SyncStorageBackend::ProcessSyncChanges(
const tracked_objects::Location& from_here,
const syncer::SyncChangeList& sync_changes) {
DCHECK_CURRENTLY_ON(BrowserThread::FILE);
DCHECK(sync_processor_.get());
// Group changes by extension, to pass all changes in a single method call.
std::map<std::string, SettingSyncDataList> grouped_sync_data;
for (syncer::SyncChangeList::const_iterator it = sync_changes.begin();
it != sync_changes.end();
++it) {
SettingSyncData data(*it);
grouped_sync_data[data.extension_id()].push_back(data);
}
// Create any storage areas that don't exist yet but have sync data.
base::DictionaryValue empty;
for (std::map<std::string, SettingSyncDataList>::iterator it =
grouped_sync_data.begin();
it != grouped_sync_data.end();
++it) {
SyncableSettingsStorage* storage =
GetOrCreateStorageWithSyncData(it->first, empty);
syncer::SyncError error = storage->ProcessSyncChanges(it->second);
if (error.IsSet())
storage->StopSyncing();
}
return syncer::SyncError();
}
void SyncStorageBackend::StopSyncing(syncer::ModelType type) {
DCHECK_CURRENTLY_ON(BrowserThread::FILE);
DCHECK(type == syncer::EXTENSION_SETTINGS || type == syncer::APP_SETTINGS);
DCHECK_EQ(sync_type_, type);
for (StorageObjMap::iterator it = storage_objs_.begin();
it != storage_objs_.end();
++it) {
// Some storage areas may have already stopped syncing if they had areas
// and syncing was disabled, but StopSyncing is safe to call multiple times.
it->second->StopSyncing();
}
sync_processor_.reset();
sync_error_factory_.reset();
}
scoped_ptr<SettingsSyncProcessor>
SyncStorageBackend::CreateSettingsSyncProcessor(const std::string& extension_id)
const {
CHECK(sync_processor_.get());
return scoped_ptr<SettingsSyncProcessor>(new SettingsSyncProcessor(
extension_id, sync_type_, sync_processor_.get()));
}
} // namespace extensions
|