PonyMirrors/philomena
1
0
Fork 0
mirror of https://github.com/philomena-dev/philomena.git synced 2025-02-07 23:06:42 +01:00
Code Issues Projects Releases Packages Wiki Activity

Use custom batch sizes tailored to each schema

Browse source
This commit is contained in:
Liam 2025-01-11 12:07:05 -05:00
parent 25bedd2aa1
commit d9309a275e
1 changed files with 12 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

14
lib/philomena/search_indexer.ex
View file

@ -40,6 +40,16 @@ defmodule Philomena.SearchIndexer do
Tag => Tags Tag => Tags
} }
@batch_sizes %{
Comment => 2048,
Filter => 2048,
Gallery => 1024,
Image => 32,
Post => 2048,
Report => 128,
Tag => 2048
}
@doc """ @doc """
Recreate the index corresponding to all schemas, and then reindex all of the Recreate the index corresponding to all schemas, and then reindex all of the
documents within. documents within.
@ -115,7 +125,7 @@ defmodule Philomena.SearchIndexer do
# Reports currently require handling for their polymorphic nature # Reports currently require handling for their polymorphic nature
Report Report
|> preload([:user, :admin]) |> preload([:user, :admin])
|> Batch.record_batches() |> Batch.record_batches(batch_size: @batch_sizes[Report])
|> Enum.each(fn records -> |> Enum.each(fn records ->
records records
|> Polymorphic.load_polymorphic(reportable: [reportable_id: :reportable_type]) |> Polymorphic.load_polymorphic(reportable: [reportable_id: :reportable_type])
@ -129,6 +139,6 @@ defmodule Philomena.SearchIndexer do
schema schema
|> preload(^context.indexing_preloads()) |> preload(^context.indexing_preloads())
|> Search.reindex(schema) |> Search.reindex(schema, batch_size: @batch_sizes[schema])
end end
end end